00000001:02000400:2.0F:1787848096.017704:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787848116.940487:0:3186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787848119.115606:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 396 MB/s 00000001:01000000:0.0F:1787848119.370772:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 554 MB/s 00000001:01000000:3.0F:1787848119.620930:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3039 MB/s 00000020:02000000:1.0:1787848120.506433:0:3278:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_86_g6a41f06 00000400:02000000:1.0:1787848121.297714:0:3294:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.126@tcp [8/256/0/180] 00008000:02000000:0.0:1787848125.709039:0:3443:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787848184.652938:0:5250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787848197.983179:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787848197.983189:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787848197.983301:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006bf80347 00000080:02000400:1.0:1787848197.983313:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787848197.989255:0:5822:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787848197.989270:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787848197.989321:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004ffc26ec) 00000020:00000080:1.0:1787848197.989344:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787848198.042891:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787848198.043355:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787848198.084709:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787848198.084753:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787848198.084775:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787848198.084822:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787848198.084845:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787848198.085270:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787848198.085279:0:5822:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787848198.085290:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cb1d1 00000020:01000004:2.0:1787848198.085298:0:5822:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787848198.085303:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787848198.085308:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006bf80347 from MGS 00000020:01000004:2.0:1787848198.085313:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787848198.085331:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000aae7a558) 00000020:00000080:2.0:1787848198.085343:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787848198.085460:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006bf80347 from MGS, refs=2 00080000:01000000:2.0:1787848198.085465:0:5822:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787848198.085474:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cb1df 00000100:00100000:2.0:1787848198.085567:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787848198.085738:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787848198.085744:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787848198.093877:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787848198.093894:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787848198.098682:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787848198.098892:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787848198.098898:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787848198.099743:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787848198.099751:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787848198.102583:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787848198.102595:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787848198.105242:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848198.105248:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848198.105250:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848198.108176:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848198.108185:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848198.108187:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848198.108835:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787848198.111782:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787848198.358384:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2791 MB/s 00000001:01000000:1.0:1787848198.611558:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2822 MB/s 00000001:01000000:2.0:1787848198.862410:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 334 MB/s 00000001:01000000:0.0:1787848199.111906:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 519 MB/s 00080000:10000000:1.0:1787848199.141047:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1787848199.151924:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787848199.173951:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787848199.175128:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787848199.175132:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787848199.179448:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787848199.181656:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787848199.181727:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787848199.182070:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787848199.182125:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787848199.182517:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787848199.182723:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787848199.182730:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787848199.184066:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787848199.184077:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787848199.187369:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787848199.187382:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787848199.193616:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:2.0:1787848199.194288:0:5838:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:0.0:1787848199.194819:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.126@tcp' 00000020:01000004:0.0:1787848199.194822:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787848199.194928:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.126@tcp (typ=mgc) 00000020:00000080:0.0:1787848199.194948:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.126@tcp (000000003f56a5ca) 00000020:00000080:0.0:1787848199.194968:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787848199.195116:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dd50a8bd@MGC192.168.201.126@tcp: add connection 192.168.201.126@tcp at head 00010000:00010000:0.0:1787848199.195319:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.126@tcp-0 is initialized 00000040:01000000:0.0:1787848199.195325:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787848199.200886:0:5839:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787848199.200930:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.126@tcp (uuid ee9ab6f4-b2e0-4733-95b2-22f99571fbe7) 00000020:00000080:0.0:1787848199.200952:0:5822:0:(genops.c:1385:class_connect()) connect: client ee9ab6f4-b2e0-4733-95b2-22f99571fbe7, cookie 0x9aeb41e0543cb1ed 00000100:00080000:0.0:1787848199.200974:0:5822:0:(import.c:510:import_select_connection()) MGC192.168.201.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787848199.200980:0:5822:0:(import.c:624:import_select_connection()) MGC192.168.201.126@tcp: import 00000000dd50a8bd using connection 192.168.201.126@tcp/0@lo 00000100:00100000:0.0:1787848199.201013:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bb660593 x1874694631325824/t0(0) o250->MGC192.168.201.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787848199.201068:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ee9ab6f4-b2e0-4733-95b2-22f99571fbe7->MGS 00000020:01000004:0.0:1787848199.201093:0:5822:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787848199.201098:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787848199.201111:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b0cefdde) 00000020:00000080:0.0:1787848199.201123:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787848199.204199:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb660593 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3309:1874694631325824:0@lo:250: 00000100:00100000:3.0:1787848199.204330:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848199.204418:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631325824 00000100:00100000:3.0:1787848199.204426:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631325824 00000100:00100000:3.0:1787848199.204467:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787848199.204473:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005568a6da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874694631325824:12345-0@lo:250: 00010000:00080000:3.0:1787848199.204497:0:5835:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from ee9ab6f4-b2e0-4733-95b2-22f99571fbe7@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:3.0:1787848199.204534:0:5835:0:(genops.c:1385:class_connect()) connect: client ee9ab6f4-b2e0-4733-95b2-22f99571fbe7, cookie 0x9aeb41e0543cb1fb 00000100:00080000:3.0:1787848199.204688:0:5835:0:(import.c:65:import_set_state_nolock()) 000000002e671c85 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787848199.204736:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005568a6da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:3309:x1874694631325824:12345-0@lo:250: Request processed in 262us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848199.204744:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787848199.204777:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787848199.204785:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.126@tcp: connect to target with instance 0 00000100:00080000:3.0:1787848199.204792:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787848199.204796:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787848199.204799:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000dd50a8bd MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787848199.204802:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787848199.204804:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787848199.204809:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb660593 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3309:1874694631325824:0@lo:250: 00000100:00100000:0.0:1787848199.244803:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787848199.245215:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787848199.245222:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787848199.249576:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787848199.249591:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787848199.251769:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787848199.251780:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787848199.253007:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787848199.253224:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787848199.253230:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787848199.253750:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787848199.253757:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787848199.330154:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787848199.330378:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787848199.330384:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787848199.333534:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787848199.333550:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787848199.334585:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787848199.336227:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787848199.336253:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787848199.337568:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787848199.337577:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787848199.339092:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787848199.339277:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787848199.339283:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787848199.339875:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787848199.339882:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787848199.340624:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787848199.341172:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787848199.341179:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787848199.341595:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787848199.341607:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787848199.362146:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787848199.362530:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787848199.362536:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787848199.364919:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787848199.364933:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787848199.370110:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787848199.370130:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787848199.374057:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787848199.374086:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787848199.374092:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787848199.374225:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787848199.374272:0:5822:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.126@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787848199.374277:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787848199.374279:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787848199.374280:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787848199.374281:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787848199.374282:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787848199.374283:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787848199.374284:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787848199.374286:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787848199.374287:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787848199.374289:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787848199.374295:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787848199.374296:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787848199.374298:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787848199.374300:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787848199.374301:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787848199.374302:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787848199.374303:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787848199.374303:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787848199.374304:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787848199.374305:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787848199.374306:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787848199.374307:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787848199.374308:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787848199.374309:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787848199.374309:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787848199.374336:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787848199.374354:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa93657a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631325952:0@lo:253: 00000100:00100000:3.0:1787848199.374434:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848199.374502:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045614832 going to sleep for 11 seconds 00000100:00100000:2.0:1787848199.374624:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631325952 00000100:00100000:2.0:1787848199.374632:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631325952 00000100:00100000:2.0:1787848199.374871:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787848199.374880:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081f32ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:5822:x1874694631325952:12345-0@lo:253: 20000000:01000000:2.0:1787848199.375088:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787848199.375091:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787848199.375539:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787848199.375588:0:5837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787848199.376274:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787848199.379220:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787848199.379507:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787848199.379512:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787848199.379518:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787848199.379521:0:5837:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787848199.379536:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787848199.380204:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787848199.380486:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787848199.380503:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787848199.380555:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787848199.380605:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787848199.380869:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787848199.381131:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787848199.381140:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787848199.381420:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787848199.381430:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787848199.381464:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787848199.381481:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787848199.381518:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787848199.381568:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787848199.381606:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787848199.381612:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787848199.381627:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787848199.382207:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787848199.382224:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787848199.382264:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787848199.382298:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787848199.382347:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787848199.382360:0:5837:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787848199.382454:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787848199.382463:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787848199.382506:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787848199.382541:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787848199.382576:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787848199.382587:0:5837:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787848199.383339:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787848199.383353:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787848199.383395:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787848199.383433:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787848199.384141:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787848199.384213:0:5837:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787848199.384221:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787848199.385193:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787848199.385531:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787848199.385556:0:5837:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.126@tcp for mdt 20000000:01000000:3.0:1787848199.385558:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.126@tcp (null) (null) (null) 00000040:00080000:3.0:1787848199.385595:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787848199.385604:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787848199.385630:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787848199.385888:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.126@tcp (null) (null) 00000040:00080000:3.0:1787848199.385995:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787848199.386007:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787848199.386071:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787848199.386126:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787848199.386198:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787848199.386201:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787848199.386205:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787848199.386217:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787848199.386220:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787848199.386250:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787848199.386251:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787848199.387481:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787848199.387828:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787848199.387870:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787848199.387903:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787848199.387917:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787848199.387929:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787848199.389942:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787848199.390404:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787848199.390443:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787848199.390503:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1787848199.390517:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787848199.390519:0:5837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787848199.390523:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787848199.390526:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787848199.390531:0:5837:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787848199.390537:0:5837:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787848199.391393:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787848199.391512:0:5837:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787848199.409302:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787848199.409359:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787848199.409435:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787848199.409476:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787848199.409496:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000015428e21/0x9aeb41e0543cb202 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848199.409513:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000015428e21/0x9aeb41e0543cb202 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848199.409523:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000015428e21/0x9aeb41e0543cb202 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848199.409530:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000015428e21/0x9aeb41e0543cb202 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848199.409536:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000015428e21/0x9aeb41e0543cb202 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848199.409543:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000015428e21/0x9aeb41e0543cb202 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848199.409548:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000015428e21 already unused, calling callback (0000000006fa5f61) 00010000:00010000:0.0:1787848199.409552:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000015428e21/0x9aeb41e0543cb202 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848199.409558:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000015428e21/0x9aeb41e0543cb202 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848199.409570:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000015428e21/0x9aeb41e0543cb202 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848199.409578:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000015428e21/0x9aeb41e0543cb202 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848199.409583:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000015428e21/0x9aeb41e0543cb202 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787848199.409610:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787848199.748815:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081f32ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:5822:x1874694631325952:12345-0@lo:253: Request processed in 373929us (374373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848199.748839:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787848199.748999:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa93657a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631325952:0@lo:253: 10000000:01000000:2.0:1787848199.749014:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787848199.749018:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787848199.749020:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787848199.749021:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848199.749022:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787848199.749034:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848199.749035:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848199.749037:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787848199.749038:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787848199.749040:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787848199.749041:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848199.749042:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787848199.749065:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006bf80347 from lustre-MDT0000 10000000:01000000:2.0:1787848199.749089:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787848199.749091:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787848199.749096:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93ff520ab3a0 10000000:01000000:2.0:1787848199.749101:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787848199.749120:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93ff520ab3a0 from 1 10000000:01000000:2.0:1787848199.749130:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787848199.749279:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 0000000098fcc7d2/0x9aeb41e0543cb209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848199.749291:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 0000000098fcc7d2/0x9aeb41e0543cb209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848199.749300:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 0000000098fcc7d2/0x9aeb41e0543cb209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848199.749319:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326080:0@lo:101: 00000100:00100000:2.0:1787848199.749601:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848199.749724:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631326080 00000100:00100000:3.0:1787848199.749731:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631326080 00000100:00100000:3.0:1787848199.749772:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787848199.749780:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061c6acb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:5822:x1874694631326080:12345-0@lo:101: 00010000:00010000:3.0:1787848199.749792:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848199.749807:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000057f1f207/0x9aeb41e0543cb210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb209 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848199.749827:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000057f1f207/0x9aeb41e0543cb210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb209 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848199.749836:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000057f1f207/0x9aeb41e0543cb210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb209 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848199.749844:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000057f1f207, rc 0) 00000100:00100000:3.0:1787848199.749873:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061c6acb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+6:5822:x1874694631326080:12345-0@lo:101: Request processed in 95us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848199.749890:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787848199.749985:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0a3899c going to sleep for 11 seconds 00000100:00100000:2.0:1787848199.750001:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326080:0@lo:101: 00010000:00010000:2.0:1787848199.750012:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 0000000098fcc7d2/0x9aeb41e0543cb209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848199.750020:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 0000000098fcc7d2/0x9aeb41e0543cb209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848199.750077:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326208:0@lo:501: 00000100:00100000:2.0:1787848199.750100:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848199.750196:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631326208 00000100:00100000:1.0:1787848199.750201:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631326208 00000100:00100000:1.0:1787848199.750243:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787848199.750249:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d66152 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+6:5822:x1874694631326208:12345-0@lo:501: 00000100:00100000:1.0:1787848199.750491:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d66152 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+6:5822:x1874694631326208:12345-0@lo:501: Request processed in 242us (390us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787848199.750497:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787848199.756459:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0a3899c going to sleep for 11 seconds 00000100:00100000:2.0:1787848199.756505:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326208:0@lo:501: 10000000:01000000:2.0:1787848199.756551:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787848199.756569:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 0000000098fcc7d2/0x9aeb41e0543cb209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848199.756599:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 0000000098fcc7d2/0x9aeb41e0543cb209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848199.756608:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ff506b3000 10000000:01000000:2.0:1787848199.756614:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787848199.756619:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93ff506b3000 10000000:01000000:2.0:1787848199.756621:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787848199.756624:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93ff506b3000 from 1 10000000:01000000:2.0:1787848199.756627:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787848199.756677:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 00000000d018fcdb/0x9aeb41e0543cb217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848199.756684:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 00000000d018fcdb/0x9aeb41e0543cb217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848199.756693:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 00000000d018fcdb/0x9aeb41e0543cb217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848199.756712:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326336:0@lo:101: 00000100:00100000:2.0:1787848199.756777:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848199.756801:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0a3899c going to sleep for 11 seconds 00000100:00100000:1.0:1787848199.757045:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631326336 00000100:00100000:1.0:1787848199.757052:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631326336 00000100:00100000:1.0:1787848199.757103:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787848199.757111:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcef702f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+6:5822:x1874694631326336:12345-0@lo:101: 00010000:00010000:1.0:1787848199.757125:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848199.757139:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c84b5a9/0x9aeb41e0543cb21e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb217 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848199.757171:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c84b5a9/0x9aeb41e0543cb21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb217 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848199.757181:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c84b5a9/0x9aeb41e0543cb21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb217 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848199.757190:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c84b5a9, rc 0) 00000100:00100000:1.0:1787848199.757237:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcef702f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+7:5822:x1874694631326336:12345-0@lo:101: Request processed in 127us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848199.757243:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787848199.757679:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326336:0@lo:101: 00010000:00010000:2.0:1787848199.757693:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 00000000d018fcdb/0x9aeb41e0543cb217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848199.757700:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 00000000d018fcdb/0x9aeb41e0543cb217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848199.757730:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787848199.757745:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 00000000d018fcdb/0x9aeb41e0543cb217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848199.757751:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 00000000d018fcdb/0x9aeb41e0543cb217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848199.757757:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787848199.757761:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787848199.757765:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93ff506b3000 10000000:01000000:2.0:1787848199.757767:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787848199.757770:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787848199.757772:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787848199.757787:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 000000005bbb102a/0x9aeb41e0543cb225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848199.757793:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 000000005bbb102a/0x9aeb41e0543cb225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848199.757800:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 000000005bbb102a/0x9aeb41e0543cb225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848199.757814:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326464:0@lo:101: 00000100:00100000:2.0:1787848199.757842:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848199.757872:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0a3899c going to sleep for 11 seconds 00000100:00100000:1.0:1787848199.757969:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631326464 00000100:00100000:1.0:1787848199.757975:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631326464 00000100:00100000:1.0:1787848199.758005:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787848199.758012:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fd2d5c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+7:5822:x1874694631326464:12345-0@lo:101: 00010000:00010000:1.0:1787848199.758020:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848199.758045:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b78c7fbc/0x9aeb41e0543cb22c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb225 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848199.758058:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b78c7fbc/0x9aeb41e0543cb22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb225 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848199.758066:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b78c7fbc/0x9aeb41e0543cb22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb225 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848199.758072:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b78c7fbc, rc 0) 00000100:00100000:1.0:1787848199.758107:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fd2d5c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+8:5822:x1874694631326464:12345-0@lo:101: Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848199.758112:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787848199.758376:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326464:0@lo:101: 00010000:00010000:2.0:1787848199.758386:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 000000005bbb102a/0x9aeb41e0543cb225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848199.758402:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 000000005bbb102a/0x9aeb41e0543cb225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848199.758447:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326592:0@lo:501: 00000100:00100000:2.0:1787848199.758472:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848199.758493:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0a3899c going to sleep for 11 seconds 00000100:00100000:1.0:1787848199.758673:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631326592 00000100:00100000:1.0:1787848199.758678:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631326592 00000100:00100000:1.0:1787848199.758706:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787848199.758713:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035fc4f2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+8:5822:x1874694631326592:12345-0@lo:501: 00000100:00100000:1.0:1787848199.758943:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035fc4f2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:5822:x1874694631326592:12345-0@lo:501: Request processed in 230us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848199.758950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787848199.761333:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326592:0@lo:501: 00000100:00100000:2.0:1787848199.761568:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326720:0@lo:503: 00000100:00100000:2.0:1787848199.761723:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848199.761755:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0a3899c going to sleep for 11 seconds 00000100:00100000:1.0:1787848199.761953:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631326720 00000100:00100000:1.0:1787848199.761961:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631326720 00000100:00100000:1.0:1787848199.762015:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787848199.762035:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008761879f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:5822:x1874694631326720:12345-0@lo:503: 00000100:00100000:1.0:1787848199.762550:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008761879f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:5822:x1874694631326720:12345-0@lo:503: Request processed in 527us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848199.762558:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848199.762677:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631326720:0@lo:503: 00000100:00100000:1.0:1787848199.763014:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa111778 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5865:1874694631326848:0@lo:502: 00000100:00100000:1.0:1787848199.763073:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848199.763146:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000230f0d5c going to sleep for 11 seconds 00000100:00100000:3.0:1787848199.768308:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631326848 00000100:00100000:3.0:1787848199.768324:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631326848 00000100:00100000:3.0:1787848199.768669:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787848199.768679:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002838e0ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:5865:x1874694631326848:12345-0@lo:502: 00000100:00100000:3.0:1787848199.768956:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002838e0ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:5865:x1874694631326848:12345-0@lo:502: Request processed in 278us (5882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848199.768964:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787848199.769052:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa111778 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5865:1874694631326848:0@lo:502: 00000020:01000000:3.0:1787848199.769091:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787848199.769102:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848199.769104:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787848199.769110:0:5865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787848199.769112:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787848199.769672:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000eb9eb801) 00000020:00000080:3.0:1787848199.769692:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787848199.769700:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787848199.769778:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787848199.769794:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cb23a 00000020:00000080:3.0:1787848199.770034:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787848199.770040:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848199.770043:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848199.770045:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787848199.770048:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787848199.770052:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848199.770053:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787848199.770058:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787848199.770064:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000eee27ca4) 00000020:00000080:3.0:1787848199.770075:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787848199.770087:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787848199.770089:0:5865:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787848199.770092:0:5865:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787848199.770097:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787848199.770151:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006bf80347 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787848199.770897:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000042138e4d) 00000020:00000080:3.0:1787848199.770910:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787848199.770985:0:5865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787848199.771002:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aeb41e0543cb24f 00000020:00000080:3.0:1787848199.771145:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787848199.771152:0:5865:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787848199.772688:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9aeb41e0543cb256 00080000:01000000:3.0:1787848199.772703:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787848199.772708:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cb25d 00080000:10000000:3.0:1787848199.774825:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787848199.776546:0:5865:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787848199.782772:0:5865:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787848199.913175:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787848199.915415:0:5865:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787848199.917946:0:5865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787848199.918378:0:5865:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787848199.986380:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a51d7465) 00000020:00000080:1.0:1787848199.986401:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787848199.987604:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787848199.987616:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cb26b 00000020:00000080:1.0:1787848200.013909:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787848200.015281:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787848200.074811:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787848200.123720:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:3.0:1787848200.176000:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787848200.185054:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787848200.225970:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848200.261605:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787848200.306956:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9aeb41e0543cb272 00000020:00000080:0.0:1787848200.307457:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787848200.307469:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848200.307475:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848200.307477:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787848200.307480:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848200.307484:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848200.307486:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787848200.307488:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787848200.307489:0:5865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787848200.307492:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848200.307494:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848200.307496:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787848200.307498:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848200.307502:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848200.307503:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787848200.307507:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787848200.307542:0:5865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787848200.307595:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2eaa5c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5865:1874694631326976:0@lo:502: 00000100:00100000:0.0:1787848200.307727:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848200.307874:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e88fb9bc going to sleep for 11 seconds 00000100:00100000:3.0:1787848200.307931:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631326976 00000100:00100000:3.0:1787848200.307940:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631326976 00000100:00100000:3.0:1787848200.307986:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787848200.307995:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009947f986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:5865:x1874694631326976:12345-0@lo:502: 00000100:00100000:3.0:1787848200.308593:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009947f986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:5865:x1874694631326976:12345-0@lo:502: Request processed in 599us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848200.308602:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787848200.308728:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2eaa5c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5865:1874694631326976:0@lo:502: 00000020:01000000:0.0:1787848200.308753:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848200.308759:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848200.308760:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787848200.308763:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787848200.308927:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787848200.308948:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787848200.308967:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 000000005bbb102a/0x9aeb41e0543cb225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848200.308992:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 000000005bbb102a/0x9aeb41e0543cb225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848200.308999:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ff506b3000 from 1 10000000:01000000:3.0:1787848200.309002:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787848200.309044:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848200.309051:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848200.309059:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848200.309074:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d490c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327104:0@lo:101: 00000100:00100000:3.0:1787848200.309106:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848200.309370:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098435fba going to sleep for 11 seconds 00000100:00100000:1.0:1787848200.309471:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631327104 00000100:00100000:1.0:1787848200.309477:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631327104 00000100:00100000:1.0:1787848200.309516:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787848200.309523:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b9112ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:5822:x1874694631327104:12345-0@lo:101: 00010000:00010000:1.0:1787848200.309533:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848200.309545:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e020131/0x9aeb41e0543cb280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb279 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.309564:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e020131/0x9aeb41e0543cb280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb279 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.309573:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e020131/0x9aeb41e0543cb280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb279 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.309580:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e020131, rc 0) 00000100:00100000:1.0:1787848200.309693:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b9112ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+10:5822:x1874694631327104:12345-0@lo:101: Request processed in 171us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848200.309709:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787848200.309846:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d490c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327104:0@lo:101: 00010000:00010000:3.0:1787848200.309860:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848200.309867:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848200.310627:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d490c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327232:0@lo:256: 00000100:00100000:2.0:1787848200.310897:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848200.310972:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098435fba going to sleep for 11 seconds 00000100:00100000:3.0:1787848200.311023:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631327232 00000100:00100000:3.0:1787848200.311029:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631327232 00000100:00100000:3.0:1787848200.311112:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787848200.311185:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a7452ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+10:5822:x1874694631327232:12345-0@lo:256: 20000000:01000000:3.0:1787848200.311202:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787848200.311208:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787848200.311281:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a7452ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+10:5822:x1874694631327232:12345-0@lo:256: Request processed in 99us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848200.311288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787848200.311355:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d490c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327232:0@lo:256: 10000000:01000000:2.0:1787848200.311926:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787848200.311938:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848200.311947:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848200.311954:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff506b3000 from 1 10000000:01000000:2.0:1787848200.311963:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787848200.311990:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848200.311996:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848200.312004:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848200.312028:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327360:0@lo:101: 00000100:00100000:2.0:1787848200.312063:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848200.312410:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f12f481 going to sleep for 11 seconds 00000100:00100000:1.0:1787848200.312607:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631327360 00000100:00100000:1.0:1787848200.312614:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631327360 00000100:00100000:1.0:1787848200.312671:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787848200.312679:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008190f832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+10:5822:x1874694631327360:12345-0@lo:101: 00010000:00010000:1.0:1787848200.312690:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848200.312704:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004efb5761/0x9aeb41e0543cb28e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb287 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.312726:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004efb5761/0x9aeb41e0543cb28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb287 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.312736:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004efb5761/0x9aeb41e0543cb28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb287 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.312744:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004efb5761, rc 0) 00000100:00100000:1.0:1787848200.312779:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008190f832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:5822:x1874694631327360:12345-0@lo:101: Request processed in 102us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848200.312786:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787848200.312865:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327360:0@lo:101: 00010000:00010000:2.0:1787848200.312878:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848200.312885:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848200.312934:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327488:0@lo:501: 00000100:00100000:2.0:1787848200.312961:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848200.312987:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f12f481 going to sleep for 11 seconds 00000100:00100000:1.0:1787848200.313068:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631327488 00000100:00100000:1.0:1787848200.313072:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631327488 00000100:00100000:1.0:1787848200.313087:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787848200.313092:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9cf6b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:5822:x1874694631327488:12345-0@lo:501: 00000100:00100000:1.0:1787848200.313627:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9cf6b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:5822:x1874694631327488:12345-0@lo:501: Request processed in 532us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848200.313634:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787848200.313888:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327488:0@lo:501: 00000100:00100000:2.0:1787848200.313926:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327616:0@lo:503: 00000100:00100000:2.0:1787848200.313968:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848200.314000:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f12f481 going to sleep for 11 seconds 00000100:00100000:0.0:1787848200.314087:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631327616 00000100:00100000:0.0:1787848200.314093:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631327616 00000100:00100000:0.0:1787848200.314238:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787848200.314245:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008db520be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:5822:x1874694631327616:12345-0@lo:503: 00000040:00080000:0.0:1787848200.314283:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787848200.314458:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008db520be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:5822:x1874694631327616:12345-0@lo:503: Request processed in 213us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848200.314464:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787848200.314526:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327616:0@lo:503: 00000040:00080000:1.0:1787848200.315485:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787848200.315753:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787848200.315772:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787848200.315795:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848200.315807:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848200.315849:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787848200.315853:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ff506b3000 10000000:01000000:2.0:1787848200.315855:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ff506b3000 10000000:01000000:2.0:1787848200.315859:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787848200.315864:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ff506b3000 from 1 10000000:01000000:2.0:1787848200.315866:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787848200.315892:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 000000000574c6b1/0x9aeb41e0543cb295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848200.315900:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 000000000574c6b1/0x9aeb41e0543cb295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848200.315908:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 000000000574c6b1/0x9aeb41e0543cb295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848200.315926:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327744:0@lo:101: 00000100:00100000:2.0:1787848200.315972:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848200.316023:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000001b3e9965 going to sleep for 11 seconds 00000100:00100000:1.0:1787848200.316076:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631327744 00000100:00100000:1.0:1787848200.316093:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631327744 00000100:00100000:1.0:1787848200.316143:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787848200.316151:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001747a3b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:5822:x1874694631327744:12345-0@lo:101: 00010000:00010000:1.0:1787848200.316162:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848200.316174:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000446c21ad/0x9aeb41e0543cb29c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.316194:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000446c21ad/0x9aeb41e0543cb29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb295 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.316203:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000446c21ad/0x9aeb41e0543cb29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb295 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.316211:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000446c21ad, rc 0) 00000100:00100000:1.0:1787848200.316245:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001747a3b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5822:x1874694631327744:12345-0@lo:101: Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848200.316251:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787848200.316380:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327744:0@lo:101: 00010000:00010000:2.0:1787848200.316393:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 000000000574c6b1/0x9aeb41e0543cb295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848200.316412:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 000000000574c6b1/0x9aeb41e0543cb295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848200.316743:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327872:0@lo:501: 00000100:00100000:2.0:1787848200.316771:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848200.316790:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000001b3e9965 going to sleep for 11 seconds 00000100:00100000:1.0:1787848200.316867:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631327872 00000100:00100000:1.0:1787848200.316873:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631327872 00000100:00100000:1.0:1787848200.316896:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787848200.316902:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004df6a8c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5822:x1874694631327872:12345-0@lo:501: 00000100:00100000:1.0:1787848200.317234:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004df6a8c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5822:x1874694631327872:12345-0@lo:501: Request processed in 331us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848200.317242:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787848200.317321:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631327872:0@lo:501: 00000100:00100000:2.0:1787848200.317419:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631328000:0@lo:503: 00000100:00100000:2.0:1787848200.317456:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848200.317487:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000001b3e9965 going to sleep for 11 seconds 00000100:00100000:1.0:1787848200.317591:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631328000 00000100:00100000:1.0:1787848200.317596:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631328000 00000100:00100000:1.0:1787848200.317629:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787848200.317637:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007285041b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5822:x1874694631328000:12345-0@lo:503: 00000100:00100000:1.0:1787848200.317888:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007285041b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5822:x1874694631328000:12345-0@lo:503: Request processed in 253us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848200.317900:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787848200.317972:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631328000:0@lo:503: 00000100:00100000:3.0:1787848200.318467:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edf089e2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5870:1874694631328128:0@lo:502: 00000100:00100000:3.0:1787848200.318509:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848200.318543:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad3387b8 going to sleep for 11 seconds 00000100:00100000:2.0:1787848200.318597:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631328128 00000100:00100000:2.0:1787848200.318602:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631328128 00000100:00100000:2.0:1787848200.318634:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787848200.318666:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f74157f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5870:x1874694631328128:12345-0@lo:502: 00000100:00100000:2.0:1787848200.319480:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f74157f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5870:x1874694631328128:12345-0@lo:502: Request processed in 814us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848200.319488:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787848200.319697:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edf089e2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5870:1874694631328128:0@lo:502: 00000020:01000004:3.0:1787848200.319763:0:5870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787848200.319780:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000000c72bbf0) 00000020:00000080:3.0:1787848200.319799:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787848200.319880:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006bf80347 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787848200.319884:0:5870:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006bf80347 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787848200.319886:0:5870:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006bf80347 4 00010000:00080000:3.0:1787848200.319916:0:5870:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000015f1cd14@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:2.0:1787848200.323008:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787848200.323277:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787848200.323316:0:5870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787848200.323464:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9aeb41e0543cb2aa 00000100:00080000:2.0:1787848200.323476:0:5870:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787848200.323482:0:5870:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000015f1cd14 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787848200.323519:0:5870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a121cf55 x1874694631328256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787848200.323556:0:5870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787848200.323675:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874694631328256:0@lo:38: 00000100:00100000:3.0:1787848200.323754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848200.323822:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631328256 00000100:00100000:3.0:1787848200.323829:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631328256 00000100:00100000:3.0:1787848200.323865:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787848200.323872:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edf089e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874694631328256:12345-0@lo:38: 00000100:00100000:3.0:1787848200.323925:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edf089e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874694631328256:12345-0@lo:38: Request processed in 53us (172us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787848200.323932:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787848200.323963:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787848200.323977:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000015f1cd14 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787848200.323981:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787848200.323984:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a121cf55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874694631328256:0@lo:38: 00000100:00100000:3.0:1787848200.324516:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085cbd72c pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5870:1874694631328384:0@lo:502: 00000100:00100000:3.0:1787848200.324562:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848200.324587:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631328384 00000100:00100000:3.0:1787848200.324590:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631328384 00000100:00100000:3.0:1787848200.324616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787848200.324623:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a61b9ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5870:x1874694631328384:12345-0@lo:502: 00000100:00100000:3.0:1787848200.324840:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a61b9ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5870:x1874694631328384:12345-0@lo:502: Request processed in 217us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848200.324847:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787848200.324885:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad3387b8 going to sleep for 11 seconds 00000100:00100000:3.0:1787848200.324898:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085cbd72c pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5870:1874694631328384:0@lo:502: 00000040:00080000:3.0:1787848200.324919:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787848200.325077:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787848200.325096:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787848200.325211:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 000000000574c6b1/0x9aeb41e0543cb295 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848200.325222:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 000000000574c6b1/0x9aeb41e0543cb295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787848200.325266:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787848200.325268:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787848200.325269:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848200.325270:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848200.325271:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848200.325273:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848200.325274:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787848200.325275:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787848200.325277:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787848200.325278:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787848200.325280:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848200.325281:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787848200.325284:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787848200.325287:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787848200.325288:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787848200.325289:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848200.325290:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848200.325291:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848200.325292:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848200.325293:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787848200.325294:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787848200.325295:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787848200.325296:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787848200.325297:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848200.325298:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787848200.325312:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787848200.325389:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035bd5917 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631328512:0@lo:253: 00000100:00100000:2.0:1787848200.325427:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848200.325491:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f12f481 going to sleep for 11 seconds 00000100:00100000:3.0:1787848200.327903:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631328512 00000100:00100000:3.0:1787848200.327915:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631328512 00000100:00100000:2.0:1787848200.328023:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787848200.328032:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f87ec49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5822:x1874694631328512:12345-0@lo:253: 20000000:01000000:2.0:1787848200.328072:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787848200.328088:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787848200.393517:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787848200.393537:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787848200.393608:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787848200.393613:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787848200.393633:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.393676:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009e020131/0x9aeb41e0543cb280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb279 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.393684:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.393724:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009e020131/0x9aeb41e0543cb280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb279 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848200.393736:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009e020131/0x9aeb41e0543cb280 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb279 expref: 12 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848200.393750:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ac6a684 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874694631328640:0@lo:104: 00000100:00100000:1.0:1787848200.393813:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848200.393866:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 0000000067aaf9ec going to sleep for 11 seconds 00000100:00100000:0.0:1787848200.395266:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631328640 00000100:00100000:0.0:1787848200.395275:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631328640 00000100:00100000:0.0:1787848200.395319:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848200.395338:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa111778 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5858:x1874694631328640:12345-0@lo:104: 00010000:00010000:0.0:1787848200.395352:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395417:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787848200.395421:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa111778 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5858:x1874694631328640:12345-0@lo:104: Request processed in 86us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848200.395427:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848200.395465:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ac6a684 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874694631328640:0@lo:104: 00010000:00010000:0.0:1787848200.395487:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395503:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848200.395508:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395515:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b9974d9 already unused, calling callback (00000000c20d8746) 10000000:00010000:0.0:1787848200.395518:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395542:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848200.395548:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848200.395553:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787848200.395582:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395587:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787848200.395602:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395608:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: 000000003b9974d9/0x9aeb41e0543cb279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb280 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395624:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848200.395626:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848200.395627:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848200.395695:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2eaa5c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631328768:0@lo:103: 00000100:00100000:0.0:1787848200.395726:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848200.395791:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631328768 00000100:00100000:0.0:1787848200.395795:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631328768 00010000:00010000:0.0:1787848200.395809:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009e020131/0x9aeb41e0543cb280 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb279 expref: 13 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848200.395827:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848200.395831:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018e49d37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:3311:x1874694631328768:12345-0@lo:103: 00010000:00010000:0.0:1787848200.395845:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848200.395848:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009e020131/0x9aeb41e0543cb280 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb279 expref: 13 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395857:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009e020131/0x9aeb41e0543cb280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb279 expref: 13 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395868:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009e020131/0x9aeb41e0543cb280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb279 expref: 13 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395879:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395886:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787848200.395897:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002284776s 00010000:00010000:0.0:1787848200.395901:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395906:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395911:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395917:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395922:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad0c4a1c already unused, calling callback (0000000006fa5f61) 00010000:00010000:0.0:1787848200.395925:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395939:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395949:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.395959:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848200.395986:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018e49d37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:3311:x1874694631328768:12345-0@lo:103: Request processed in 154us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848200.395992:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787848200.396011:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.396029:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848200.396034:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ad0c4a1c/0x9aeb41e0543cb2b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848200.396058:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2eaa5c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631328768:0@lo:103: 00000100:00100000:2.0:1787848200.401677:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f87ec49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:5822:x1874694631328512:12345-0@lo:253: Request processed in 73639us (76242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848200.401694:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787848200.401804:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035bd5917 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5822:1874694631328512:0@lo:253: 10000000:01000000:3.0:1787848200.401819:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787848200.401822:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787848200.401824:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787848200.401825:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787848200.401827:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787848200.401828:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787848200.401829:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787848200.401830:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787848200.401831:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787848200.401833:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787848200.401834:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787848200.401849:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787848200.401850:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787848200.401866:0:5822:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787848200.412947:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848200.413365:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787848200.413598:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848200.413803:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787848200.414004:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848200.414191:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787848200.416585:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848200.416876:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787848200.417083:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848200.417531:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787848200.417881:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848200.418079:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787848200.484897:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787848200.525302:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787848200.525790:0:5875:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787848200.525794:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787848200.525852:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787848200.534594:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787848200.534833:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787848200.538715:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787848200.538754:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787848200.539000:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787848200.540107:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787848200.544420:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787848200.544478:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787848200.544787:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787848200.544953:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787848200.557863:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787848200.558029:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787848200.558235:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787848200.558383:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787848200.558554:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787848200.558711:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787848200.558877:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787848200.559048:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787848200.559216:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787848200.559352:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787848200.559500:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787848200.559671:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787848200.559828:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787848200.559974:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787848200.560143:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787848200.560286:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787848200.560622:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787848200.560799:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787848200.560969:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787848200.568598:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787848200.569009:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787848200.569195:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787848200.569551:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787848200.569743:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787848200.569908:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787848200.570079:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787848200.570413:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787848200.570549:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787848200.571802:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787848200.571965:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787848200.574798:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787848200.577224:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787848200.577565:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787848200.615779:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787848200.724629:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787848200.724690:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9c041cfb988 00100000:10000000:1.0:1787848200.724698:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787848200.725371:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787848200.725386:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787848200.725399:0:5822:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787848200.725417:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787848200.815616:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787848200.815710:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787848200.815715:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787848201.199802:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848202.223768:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848203.254783:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848204.272865:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848205.305422:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787848205.679910:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787848205.679920:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787848205.679932:0:8:0:(import.c:65:import_set_state_nolock()) 0000000015f1cd14 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787848205.679947:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000015f1cd14 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787848205.679969:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009d490c7f x1874694631329024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787848205.680003:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d490c7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874694631329024:0@lo:38: 00000100:00100000:3.0:1787848205.680067:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848205.680758:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000438a0b2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631328896:0@lo:400: 00000100:00100000:1.0:1787848205.680802:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848205.680885:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631328896 00000100:00100000:1.0:1787848205.680893:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631328896 00000100:00100000:1.0:1787848205.680945:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787848205.680952:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037528db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:3312:x1874694631328896:12345-0@lo:400: 00000100:00100000:1.0:1787848205.681000:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037528db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:3312:x1874694631328896:12345-0@lo:400: Request processed in 48us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848205.681005:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787848205.681051:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000438a0b2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631328896:0@lo:400: 00000100:00100000:1.0:1787848205.685746:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631329024 00000100:00100000:1.0:1787848205.685761:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631329024 00000100:00100000:1.0:1787848205.685805:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787848205.685813:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa93657a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874694631329024:12345-0@lo:38: 00010000:00080000:1.0:1787848205.685844:0:5844:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:1.0:1787848205.685882:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9aeb41e0543cb2b8 00000004:00100000:1.0:1787848205.685946:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787848205.686063:0:5844:0:(import.c:65:import_set_state_nolock()) 0000000010eab9db : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787848205.686154:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa93657a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874694631329024:12345-0@lo:38: Request processed in 341us (6087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848205.686161:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787848205.690521:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009d490c7f x1874694631329024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787848215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787848205.690545:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787848205.690554:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787848205.690560:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787848205.690563:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000015f1cd14 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787848205.690570:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d490c7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874694631329024:0@lo:38: 00010000:00010000:0.0:1787848206.323031:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787848206.547215:0:6119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787848207.349306:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848208.367791:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787848208.751711:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787848208.751719:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ff506b3000 from 3 10000000:01000000:0.0:1787848208.751743:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787848208.751784:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 00000000af72f746/0x9aeb41e0543cb2bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848208.751797:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 00000000af72f746/0x9aeb41e0543cb2bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848208.751806:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 00000000af72f746/0x9aeb41e0543cb2bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848208.751829:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e382edc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631329152:0@lo:101: 00000100:00100000:0.0:1787848208.751914:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848208.751964:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028f43366 going to sleep for 11 seconds 00000100:00100000:2.0:1787848208.752215:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631329152 00000100:00100000:2.0:1787848208.752225:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631329152 00000100:00100000:2.0:1787848208.752282:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787848208.752292:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d6cfbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:5839:x1874694631329152:12345-0@lo:101: 00010000:00010000:2.0:1787848208.752329:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848208.752347:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001aa46b7f/0x9aeb41e0543cb2c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb2bf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848208.752369:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001aa46b7f/0x9aeb41e0543cb2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb2bf expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848208.752378:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001aa46b7f/0x9aeb41e0543cb2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb2bf expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848208.752386:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001aa46b7f, rc 0) 00000100:00100000:2.0:1787848208.752433:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d6cfbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5839:x1874694631329152:12345-0@lo:101: Request processed in 144us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848208.752439:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787848208.752557:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e382edc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631329152:0@lo:101: 00010000:00010000:0.0:1787848208.752569:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 00000000af72f746/0x9aeb41e0543cb2bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848208.752576:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 00000000af72f746/0x9aeb41e0543cb2bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848208.752617:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e382edc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631329280:0@lo:256: 00000100:00100000:0.0:1787848208.752699:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848208.752732:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028f43366 going to sleep for 11 seconds 00000100:00100000:1.0:1787848208.752804:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631329280 00000100:00100000:1.0:1787848208.752810:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631329280 00000100:00100000:1.0:1787848208.752837:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787848208.752844:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c234d588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5839:x1874694631329280:12345-0@lo:256: 20000000:01000000:1.0:1787848208.752859:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787848208.752891:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787848208.752894:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787848208.752970:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c234d588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5839:x1874694631329280:12345-0@lo:256: Request processed in 127us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848208.752982:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787848208.753054:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e382edc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631329280:0@lo:256: 10000000:01000000:0.0:1787848208.753100:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787848208.753107:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 00000000af72f746/0x9aeb41e0543cb2bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848208.753114:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 00000000af72f746/0x9aeb41e0543cb2bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848209.392100:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848210.417874:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848210.803758:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000049fe1aa6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631329408:0@lo:400: 00000100:00100000:0.0:1787848210.803852:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848210.803921:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e592771 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631329536:0@lo:400: 00000100:00100000:0.0:1787848210.803946:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848210.803983:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631329536 00000100:00100000:0.0:1787848210.803989:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631329536 00000100:00100000:0.0:1787848210.804024:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848210.804029:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab013684 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631329536:12345-0@lo:400: 00000100:00100000:0.0:1787848210.804064:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab013684 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631329536:12345-0@lo:400: Request processed in 36us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848210.804069:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787848210.804096:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000e592771 x1874694631329536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848210.804106:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e592771 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631329536:0@lo:400: 00000100:00100000:2.0:1787848210.804279:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631329408 00000100:00100000:2.0:1787848210.804283:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631329408 00000100:00100000:2.0:1787848210.804304:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787848210.804307:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da0e5e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:3313:x1874694631329408:12345-0@lo:400: 00000100:00100000:2.0:1787848210.804334:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da0e5e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:3313:x1874694631329408:12345-0@lo:400: Request processed in 27us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848210.804338:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787848210.804465:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000049fe1aa6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631329408:0@lo:400: 00010000:00010000:2.0:1787848211.448757:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848212.466302:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787848212.491368:0:6321:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcba12f920 20000000:00000080:1.0:1787848212.491387:0:6321:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ff7a494800 uarg=0000000000000000 20000000:01000000:1.0:1787848212.491419:0:6321:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787848212.491425:0:6321:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787848212.491430:0:6321:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787848212.492053:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787848212.492070:0:6321:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787848212.495616:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787848212.496064:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787848212.496206:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787848212.496267:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787848212.496290:0:6321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787848212.496311:0:6321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848212.496332:0:6321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004efb5761/0x9aeb41e0543cb28e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb287 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848212.496341:0:6321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848212.496380:0:6321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004efb5761/0x9aeb41e0543cb28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb287 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848212.496393:0:6321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004efb5761/0x9aeb41e0543cb28e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb287 expref: 11 pid: 5836 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848212.496407:0:6321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000500fc45a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1874694631329664:0@lo:104: 00000100:00100000:1.0:1787848212.496473:0:6321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848212.496559:0:6321:0:(client.c:2715:ptlrpc_set_wait()) set 00000000feb08c06 going to sleep for 11 seconds 00000100:00100000:0.0:1787848212.496860:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631329664 00000100:00100000:0.0:1787848212.496868:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631329664 00000100:00100000:0.0:1787848212.496926:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787848212.496934:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088f0f446 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:6321:x1874694631329664:12345-0@lo:104: 00010000:00010000:0.0:1787848212.496945:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497005:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787848212.497015:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088f0f446 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:6321:x1874694631329664:12345-0@lo:104: Request processed in 83us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848212.497023:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787848212.497042:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848212.497047:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497053:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000b60ab4b already unused, calling callback (00000000c20d8746) 10000000:00010000:0.0:1787848212.497056:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497063:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848212.497069:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848212.497074:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787848212.497100:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497107:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787848212.497123:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497129:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: 000000000b60ab4b/0x9aeb41e0543cb287 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb28e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497144:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848212.497146:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848212.497147:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848212.497165:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787848212.497176:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad7994d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631329792:0@lo:103: 00000100:00100000:0.0:1787848212.497206:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848212.497236:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631329792 00000100:00100000:0.0:1787848212.497240:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631329792 00010000:00010000:0.0:1787848212.497256:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004efb5761/0x9aeb41e0543cb28e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb287 expref: 12 pid: 5836 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848212.497274:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787848212.497279:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e382edc9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:3310:x1874694631329792:12345-0@lo:103: 00010000:00010000:0.0:1787848212.497288:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848212.497291:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004efb5761/0x9aeb41e0543cb28e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb287 expref: 12 pid: 5836 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497300:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004efb5761/0x9aeb41e0543cb28e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb287 expref: 12 pid: 5836 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497315:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497322:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497332:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497338:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497344:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497359:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497364:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006b11f7c7 already unused, calling callback (0000000006fa5f61) 00010000:00010000:0.0:1787848212.497366:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497372:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497379:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848212.497388:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848212.497412:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e382edc9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:3310:x1874694631329792:12345-0@lo:103: Request processed in 133us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848212.497418:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787848212.497450:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad7994d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631329792:0@lo:103: 00010000:00010000:2.0:1787848212.497471:0:6321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004efb5761/0x9aeb41e0543cb28e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb287 expref: 11 pid: 5836 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848212.497481:0:6321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000500fc45a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1874694631329664:0@lo:104: 00010000:00010000:2.0:1787848212.497496:0:6321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848212.497510:0:6321:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848212.497515:0:6321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848212.497519:0:6321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006b11f7c7/0x9aeb41e0543cb2cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848213.491728:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848214.511900:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787848214.639782:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787848214.639789:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff506b3000 from 1 10000000:01000000:0.0:1787848214.639794:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787848214.639845:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 000000005c0d51b8/0x9aeb41e0543cb2d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848214.639858:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 000000005c0d51b8/0x9aeb41e0543cb2d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848214.639868:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 000000005c0d51b8/0x9aeb41e0543cb2d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848214.639907:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad7994d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631329920:0@lo:101: 00000100:00100000:0.0:1787848214.639989:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848214.640282:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631329920 00000100:00100000:2.0:1787848214.640292:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631329920 00000100:00100000:2.0:1787848214.640343:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787848214.640351:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff35ab35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:5839:x1874694631329920:12345-0@lo:101: 00010000:00010000:2.0:1787848214.640364:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848214.640377:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b60ab4b/0x9aeb41e0543cb2db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb2d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848214.640398:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b60ab4b/0x9aeb41e0543cb2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb2d4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848214.640408:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b60ab4b/0x9aeb41e0543cb2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb2d4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848214.640416:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b60ab4b, rc 0) 00000100:00100000:2.0:1787848214.640450:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff35ab35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5839:x1874694631329920:12345-0@lo:101: Request processed in 100us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848214.640456:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787848214.640515:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028f43366 going to sleep for 11 seconds 00000100:00100000:0.0:1787848214.640536:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad7994d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631329920:0@lo:101: 00010000:00010000:0.0:1787848214.640550:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 000000005c0d51b8/0x9aeb41e0543cb2d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848214.640557:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 000000005c0d51b8/0x9aeb41e0543cb2d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848214.640609:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad7994d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631330048:0@lo:501: 00000100:00100000:0.0:1787848214.640632:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848214.640679:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631330048 00000100:00100000:0.0:1787848214.640681:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028f43366 going to sleep for 11 seconds 00000100:00100000:1.0:1787848214.640684:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631330048 00000100:00100000:1.0:1787848214.640716:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787848214.640723:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000837780ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5839:x1874694631330048:12345-0@lo:501: 00000100:00100000:1.0:1787848214.641005:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000837780ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5839:x1874694631330048:12345-0@lo:501: Request processed in 283us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848214.641013:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787848214.641378:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad7994d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631330048:0@lo:501: 00000100:00100000:0.0:1787848214.641407:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad7994d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631330176:0@lo:503: 00000100:00100000:0.0:1787848214.641458:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848214.642033:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631330176 00000100:00100000:1.0:1787848214.642039:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631330176 00000100:00100000:1.0:1787848214.642078:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787848214.642086:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0c9c963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5839:x1874694631330176:12345-0@lo:503: 00000100:00100000:1.0:1787848214.642239:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0c9c963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5839:x1874694631330176:12345-0@lo:503: Request processed in 155us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848214.642246:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787848214.642811:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028f43366 going to sleep for 11 seconds 00000100:00100000:0.0:1787848214.642829:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad7994d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631330176:0@lo:503: 00000100:00100000:0.0:1787848214.643818:0:6389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad7994d5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6389:1874694631330304:0@lo:502: 00000100:00100000:0.0:1787848214.643886:0:6389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848214.643922:0:6389:0:(client.c:2715:ptlrpc_set_wait()) set 000000003acba70f going to sleep for 11 seconds 00000100:00100000:1.0:1787848214.644563:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631330304 00000100:00100000:1.0:1787848214.644571:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631330304 00000100:00100000:0.0:1787848214.645140:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787848214.645151:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003646ee02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6389:x1874694631330304:12345-0@lo:502: 00000100:00100000:0.0:1787848214.647737:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003646ee02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6389:x1874694631330304:12345-0@lo:502: Request processed in 2582us (3844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848214.647775:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787848214.649881:0:6389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad7994d5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6389:1874694631330304:0@lo:502: 00000020:01000000:1.0:1787848214.649930:0:6389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787848214.649942:0:6389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848214.649945:0:6389:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787848214.649952:0:6389:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ff506b3000 00000020:00000080:1.0:1787848214.649955:0:6389:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787848214.650013:0:6389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6389:1874694631330432:0@lo:502: 00000100:00100000:1.0:1787848214.650209:0:6389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848214.650328:0:6389:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff4562c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848214.650566:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631330432 00000100:00100000:0.0:1787848214.650573:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631330432 00000100:00100000:0.0:1787848214.650630:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787848214.650661:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6389:x1874694631330432:12345-0@lo:502: 00000100:00100000:0.0:1787848214.650915:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6389:x1874694631330432:12345-0@lo:502: Request processed in 277us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848214.650923:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787848214.655187:0:6389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6389:1874694631330432:0@lo:502: 00000020:01000000:0.0:1787848214.658249:0:6389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848214.658266:0:6389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848214.658268:0:6389:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787848214.658276:0:6389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787848214.658445:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787848214.658467:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787848214.658477:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030a00/0x9aeb41e0543cb2d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848214.658488:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff40030a00/0x9aeb41e0543cb2d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848215.540370:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848215.921510:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631330688:0@lo:400: 00000100:00100000:2.0:1787848215.921672:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848215.921803:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787848215.921812:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631330560:0@lo:400: 00000100:00100000:2.0:1787848215.921899:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848215.921946:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631330688 00000100:00100000:2.0:1787848215.921953:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631330688 00000100:00100000:2.0:1787848215.922024:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787848215.922050:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631330688:12345-0@lo:400: 00000100:00100000:2.0:1787848215.922137:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631330688:12345-0@lo:400: Request processed in 93us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848215.922146:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787848215.922179:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631330560 00000100:00100000:2.0:1787848215.922183:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631330560 00000100:00100000:2.0:1787848215.922235:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787848215.922243:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:3313:x1874694631330560:12345-0@lo:400: 00000100:00100000:2.0:1787848215.922324:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:3313:x1874694631330560:12345-0@lo:400: Request processed in 67us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848215.922345:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787848215.922451:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631330560:0@lo:400: 00010000:00080000:2.0:1787848215.922466:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ff58d0a580 x1874694631330688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848215.922478:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631330688:0@lo:400: 00010000:00010000:0.0:1787848216.559914:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848217.583946:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848218.612613:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787848219.619762:0:6687:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787848219.619767:0:6687:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787848219.619917:0:6687:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93ff4314e000 00000020:01000004:2.0:1787848219.619933:0:6687:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787848219.619944:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787848219.619963:0:6687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93ff6ee68000) 00000020:00000080:2.0:1787848219.619987:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787848219.643223:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787848219.643477:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:2.0:1787848219.644871:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787848219.678770:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787848219.684521:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787848219.684555:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787848219.684805:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787848219.684845:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787848219.685407:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787848219.685419:0:6687:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787848219.685428:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aeb41e0543cb2e9 00000020:01000004:0.0:1787848219.685436:0:6687:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787848219.685456:0:6687:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.126@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787848219.685460:0:6687:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787848219.685466:0:6687:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787848219.685470:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787848219.685487:0:6687:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93ff520a8000) 00000020:00000080:0.0:1787848219.685496:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787848219.686958:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787848219.687451:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787848219.687459:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787848219.688360:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787848219.688376:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787848219.690958:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787848219.690970:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787848219.703214:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787848219.703738:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787848219.703746:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787848219.704459:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787848219.704466:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787848219.796814:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787848219.797112:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787848219.797119:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787848219.807888:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787848219.807904:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787848219.812150:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787848219.812231:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787848219.827530:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787848219.828236:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787848219.828244:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787848219.832464:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787848219.832478:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787848219.948278:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787848219.949871:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787848219.949880:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787848219.965717:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787848219.965772:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787848219.966447:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787848219.966469:0:6687:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787848219.966475:0:6687:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787848219.999375:0:6687:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787848219.999411:0:6687:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.126@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787848219.999415:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787848219.999417:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787848219.999418:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848219.999419:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848219.999420:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848219.999422:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848219.999423:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848219.999425:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787848219.999427:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787848219.999428:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848219.999430:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787848219.999434:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787848219.999436:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787848219.999437:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787848219.999438:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848219.999439:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848219.999440:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848219.999441:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848219.999442:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848219.999443:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787848219.999444:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787848219.999445:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848219.999446:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787848219.999473:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787848219.999496:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631330816:0@lo:253: 00000100:00100000:2.0:1787848219.999569:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848219.999632:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff44ed0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787848220.001023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631330816 00000100:00100000:0.0:1787848220.001037:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631330816 00000100:00100000:0.0:1787848220.001149:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787848220.001161:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631330816:12345-0@lo:253: 20000000:01000000:0.0:1787848220.001198:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787848220.001202:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787848220.001207:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787848220.001211:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787848220.002298:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787848220.002537:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787848220.002550:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787848220.002589:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787848220.002598:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787848220.002629:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787848220.002718:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787848220.003072:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787848220.003100:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.126@tcp 20000000:01000000:0.0:1787848220.003102:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.126@tcp (null) (null) (null) 00000040:00080000:0.0:1787848220.003138:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787848220.003146:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787848220.003195:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787848220.003204:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.126@tcp (null) (null) 00000040:00080000:0.0:1787848220.003237:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787848220.003247:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787848220.003295:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787848220.003350:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787848220.004058:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787848220.004076:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.126@tcp 20000000:01000000:0.0:1787848220.004078:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.126@tcp (null) (null) (null) 00000040:00080000:0.0:1787848220.004114:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787848220.004121:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787848220.004152:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787848220.004160:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.126@tcp (null) (null) 00000040:00080000:0.0:1787848220.004206:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787848220.004215:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787848220.004249:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787848220.004284:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787848220.004298:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787848220.004301:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787848220.004306:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787848220.004307:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787848220.004310:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787848220.004333:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787848220.004335:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787848220.004364:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787848220.004367:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787848220.005359:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1787848220.005420:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1787848220.005479:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787848220.006136:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1787848220.006181:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1787848220.006223:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1787848220.006236:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787848220.006238:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787848220.007262:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787848220.007322:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787848220.007382:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787848220.008324:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787848220.008364:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787848220.008415:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787848220.008428:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787848220.008431:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787848220.009153:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787848220.009346:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787848220.009386:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787848220.009475:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1787848220.009495:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787848220.009515:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.009534:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb209 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.009542:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff414a4a00/0x9aeb41e0543cb22c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb225 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.009549:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff414a5600/0x9aeb41e0543cb29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb295 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.009555:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.009592:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff414a5600/0x9aeb41e0543cb29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb295 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.009820:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff414a5600/0x9aeb41e0543cb29c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb295 expref: 12 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848220.009858:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b1680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874694631330944:0@lo:104: 00000100:00100000:0.0:1787848220.009940:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848220.010110:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631330944 00000100:00100000:3.0:1787848220.010117:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631330944 00000100:00100000:3.0:1787848220.010164:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787848220.010173:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5837:x1874694631330944:12345-0@lo:104: 00010000:00010000:3.0:1787848220.010186:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.010237:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787848220.010243:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5837:x1874694631330944:12345-0@lo:104: Request processed in 71us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848220.010250:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787848220.010270:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848220.010276:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.010284:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff413a0400 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848220.010288:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.010309:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848220.010317:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848220.010323:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787848220.010353:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.010359:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848220.010377:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb295 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.010385:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb29c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.010399:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848220.010400:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848220.010402:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848220.010421:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631331072:0@lo:103: 00000100:00100000:3.0:1787848220.010449:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848220.010484:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631331072 00000100:00100000:3.0:1787848220.010488:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631331072 00010000:00010000:3.0:1787848220.010505:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff414a5600/0x9aeb41e0543cb29c lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb295 expref: 13 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848220.010530:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787848220.010536:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:3310:x1874694631331072:12345-0@lo:103: 00010000:00010000:3.0:1787848220.010552:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848220.010558:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff414a5600/0x9aeb41e0543cb29c lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb295 expref: 13 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.010569:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff414a5600/0x9aeb41e0543cb29c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb295 expref: 13 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.010585:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848220.010629:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:3310:x1874694631331072:12345-0@lo:103: Request processed in 93us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848220.010636:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787848220.010864:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff414a4a00/0x9aeb41e0543cb22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb225 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.010875:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff414a4a00/0x9aeb41e0543cb22c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb225 expref: 12 pid: 5837 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848220.010885:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874694631331200:0@lo:104: 00000100:00100000:3.0:1787848220.010920:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631331072:0@lo:103: 00000100:00100000:0.0:1787848220.013203:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848220.013251:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631331200 00000100:00100000:3.0:1787848220.013259:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631331200 00010000:00010000:0.0:1787848220.013278:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb209 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.013291:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb209 expref: 12 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848220.013303:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874694631331328:0@lo:104: 00000100:00100000:3.0:1787848220.013308:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848220.013316:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5837:x1874694631331200:12345-0@lo:104: 00010000:00010000:3.0:1787848220.013327:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff413a0600/0x9aeb41e0543cb225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848220.013352:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848220.013363:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff506e2300 going to sleep for 11 seconds 00010000:00010000:3.0:1787848220.013381:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1787848220.013381:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff414a5600/0x9aeb41e0543cb29c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb295 expref: 12 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848220.013386:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5837:x1874694631331200:12345-0@lo:104: Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848220.013392:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787848220.013394:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b1680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874694631330944:0@lo:104: 00000100:00100000:0.0:1787848220.013401:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874694631331200:0@lo:104: 00000100:00100000:3.0:1787848220.013405:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631331328 00000100:00100000:3.0:1787848220.013408:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631331328 00000100:00100000:3.0:1787848220.013420:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787848220.013426:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5837:x1874694631331328:12345-0@lo:104: 00010000:00010000:3.0:1787848220.013433:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff413a1c00/0x9aeb41e0543cb209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.013484:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787848220.013489:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5837:x1874694631331328:12345-0@lo:104: Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848220.013496:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787848220.013513:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787848220.013518:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff413a0600/0x9aeb41e0543cb225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.013525:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff413a0600 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848220.013529:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0600/0x9aeb41e0543cb225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.013538:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff413a0600/0x9aeb41e0543cb225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848220.013545:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0600/0x9aeb41e0543cb225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848220.013551:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787848220.013554:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874694631331328:0@lo:104: 00010000:00010000:3.0:1787848220.013577:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff413a0600/0x9aeb41e0543cb225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.013577:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.013585:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848220.013598:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff413a0600/0x9aeb41e0543cb225 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.013617:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff413a0600/0x9aeb41e0543cb225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb22c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.013661:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848220.013664:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff413a1c00/0x9aeb41e0543cb209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.013670:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff413a1c00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848220.013681:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a1c00/0x9aeb41e0543cb209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.013688:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff413a1c00/0x9aeb41e0543cb209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848220.013694:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a1c00/0x9aeb41e0543cb209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848220.013698:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787848220.013713:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff413a1c00/0x9aeb41e0543cb209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.013719:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848220.013743:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff413a1c00/0x9aeb41e0543cb209 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.013751:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff413a1c00/0x9aeb41e0543cb209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.013766:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848220.013768:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848220.013769:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848220.013777:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848220.013793:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631331584:0@lo:103: 00000100:00100000:3.0:1787848220.013821:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848220.013862:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631331584 00000100:00100000:3.0:1787848220.013866:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631331584 00010000:00010000:3.0:1787848220.013883:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb209 expref: 12 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848220.013992:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631331456:0@lo:103: 00000100:00100000:2.0:1787848220.014023:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787848220.014093:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848220.014966:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631331456 00000100:00100000:3.0:1787848220.014974:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631331456 00010000:00010000:3.0:1787848220.015065:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff414a4a00/0x9aeb41e0543cb22c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb225 expref: 13 pid: 5837 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848220.015086:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848220.015094:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:3313:x1874694631331584:12345-0@lo:103: 00010000:00010000:3.0:1787848220.015127:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848220.015134:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb209 expref: 13 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015143:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb209 expref: 13 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015159:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb209 expref: 13 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015174:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848220.015274:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:3313:x1874694631331584:12345-0@lo:103: Request processed in 181us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848220.015280:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848220.015296:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787848220.015301:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:3311:x1874694631331456:12345-0@lo:103: 00010000:00010000:3.0:1787848220.015314:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848220.015319:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff414a4a00/0x9aeb41e0543cb22c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb225 expref: 11 pid: 5837 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015328:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff414a4a00/0x9aeb41e0543cb22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb225 expref: 11 pid: 5837 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015338:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff414a4a00/0x9aeb41e0543cb22c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb225 expref: 11 pid: 5837 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015348:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015356:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015370:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015377:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015385:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015391:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015395:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848220.015399:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015415:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015430:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.015440:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848220.015467:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+10:3311:x1874694631331456:12345-0@lo:103: Request processed in 166us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848220.015473:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787848220.015502:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631331456:0@lo:103: 00000100:00100000:2.0:1787848220.016507:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631331584:0@lo:103: 00010000:00010000:0.0:1787848220.018597:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.018618:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.018627:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40031400/0x9aeb41e0543cb2f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787848220.018658:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787848220.079251:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:6687:x1874694631330816:12345-0@lo:253: Request processed in 78040us (79626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848220.079265:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787848220.079337:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631330816:0@lo:253: 10000000:01000000:2.0:1787848220.079350:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787848220.079353:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787848220.079354:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787848220.079355:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848220.079356:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787848220.079357:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848220.079358:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848220.079359:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848220.079360:0:6687:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787848220.079361:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848220.079362:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787848220.079378:0:6687:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93ff4314e000 from lustre-OST0000 10000000:01000000:2.0:1787848220.079396:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787848220.079397:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787848220.079402:0:6687:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93ff520ab3a0 local copy 10000000:01000000:2.0:1787848220.079405:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787848220.079433:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.079440:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.079446:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848220.079475:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631331712:0@lo:101: 00000100:00100000:2.0:1787848220.079510:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848220.079763:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6f8eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787848220.079823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631331712 00000100:00100000:3.0:1787848220.079828:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631331712 00000100:00100000:3.0:1787848220.079935:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787848220.079945:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:6687:x1874694631331712:12345-0@lo:101: 00010000:00010000:3.0:1787848220.079958:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848220.079972:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb2fe expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.080006:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb2fe expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.080016:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb2fe expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.080024:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c6000, rc 0) 00000100:00100000:3.0:1787848220.080067:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+10:6687:x1874694631331712:12345-0@lo:101: Request processed in 125us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848220.080094:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787848220.080161:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631331712:0@lo:101: 00010000:00010000:0.0:1787848220.080173:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.080181:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848220.080288:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631331840:0@lo:501: 00000100:00100000:0.0:1787848220.080317:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848220.080542:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff506e29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848220.080845:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631331840 00000100:00100000:2.0:1787848220.080850:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631331840 00000100:00100000:2.0:1787848220.080876:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787848220.080883:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+10:6687:x1874694631331840:12345-0@lo:501: 00000100:00100000:2.0:1787848220.081713:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+10:6687:x1874694631331840:12345-0@lo:501: Request processed in 827us (1393us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787848220.081721:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787848220.081932:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631331840:0@lo:501: 10000000:01000000:0.0:1787848220.081948:0:6687:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787848220.082039:0:6687:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787848220.082047:0:6687:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082056:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082071:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082183:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787848220.082215:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ff4314e000 10000000:01000000:0.0:1787848220.082220:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787848220.082225:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93ff520ab3a0 10000000:01000000:0.0:1787848220.082228:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787848220.082231:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93ff520ab3a0 from 1 10000000:01000000:0.0:1787848220.082233:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787848220.082256:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40031400/0x9aeb41e0543cb30c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082264:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff40031400/0x9aeb41e0543cb30c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082273:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff40031400/0x9aeb41e0543cb30c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848220.082288:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631331968:0@lo:101: 00000100:00100000:0.0:1787848220.082321:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848220.082354:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff506e2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787848220.082371:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631331968 00000100:00100000:0.0:1787848220.082376:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631331968 00000100:00100000:0.0:1787848220.082413:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787848220.082421:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+10:6687:x1874694631331968:12345-0@lo:101: 00010000:00010000:0.0:1787848220.082430:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848220.082441:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40030800/0x9aeb41e0543cb313 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb30c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082470:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40030800/0x9aeb41e0543cb313 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb30c expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082480:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40030800/0x9aeb41e0543cb313 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb30c expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082488:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030800, rc 0) 00000100:00100000:0.0:1787848220.082518:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:6687:x1874694631331968:12345-0@lo:101: Request processed in 97us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848220.082524:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787848220.082555:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631331968:0@lo:101: 00010000:00010000:0.0:1787848220.082567:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff40031400/0x9aeb41e0543cb30c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb313 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082574:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff40031400/0x9aeb41e0543cb30c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb313 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848220.082585:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787848220.082593:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40031400/0x9aeb41e0543cb30c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb313 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082600:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff40031400/0x9aeb41e0543cb30c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb313 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848220.082606:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787848220.082610:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787848220.082614:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787848220.082621:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787848220.082634:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082663:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082670:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848220.082692:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332096:0@lo:101: 00000100:00100000:0.0:1787848220.082716:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848220.082734:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff506e2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787848220.082746:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631332096 00000100:00100000:0.0:1787848220.082749:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631332096 00000100:00100000:0.0:1787848220.082764:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787848220.082769:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:6687:x1874694631332096:12345-0@lo:101: 00010000:00010000:0.0:1787848220.082776:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848220.082783:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb31a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082796:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb31a expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082804:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb31a expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082810:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40031c00, rc 0) 00000100:00100000:0.0:1787848220.082835:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332096:12345-0@lo:101: Request processed in 65us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848220.082848:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787848220.082878:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332096:0@lo:101: 00010000:00010000:0.0:1787848220.082887:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.082894:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848220.082950:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332224:0@lo:501: 00000100:00100000:0.0:1787848220.082973:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848220.082997:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff506e2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787848220.083009:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631332224 00000100:00100000:0.0:1787848220.083012:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631332224 00000100:00100000:0.0:1787848220.083028:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787848220.083034:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332224:12345-0@lo:501: 00000100:00100000:0.0:1787848220.083630:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332224:12345-0@lo:501: Request processed in 594us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848220.083662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787848220.083785:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332224:0@lo:501: 00000100:00100000:0.0:1787848220.083873:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332352:0@lo:503: 00000100:00100000:0.0:1787848220.083912:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848220.083977:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff506e2000 going to sleep for 11 seconds 00010000:00010000:3.0:1787848220.084158:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848220.084165:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.084173:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff413a0800 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848220.084176:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.084185:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848220.084192:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848220.084258:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787848220.084282:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.084289:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787848220.084342:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787848220.084361:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.084369:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb2fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aeb41e0543cb305 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.084382:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848220.084384:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848220.084385:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848220.084452:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631332352 00000100:00100000:2.0:1787848220.084458:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631332352 00000100:00100000:2.0:1787848220.084492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787848220.084502:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332352:12345-0@lo:503: 00000100:00100000:2.0:1787848220.084687:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332352:12345-0@lo:503: Request processed in 187us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848220.084694:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787848220.084781:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332352:0@lo:503: 00000040:00080000:0.0:1787848220.085041:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787848220.085246:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332608:0@lo:502: 00000100:00100000:0.0:1787848220.085288:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848220.085330:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff506e2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787848220.085681:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631332608 00000100:00100000:2.0:1787848220.085686:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631332608 00000100:00100000:2.0:1787848220.085714:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787848220.085721:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332608:12345-0@lo:502: 00000100:00100000:2.0:1787848220.085867:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332608:12345-0@lo:502: Request processed in 146us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848220.085873:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787848220.086326:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332608:0@lo:502: 00000040:00080000:0.0:1787848220.086605:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787848220.086698:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787848220.086736:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787848220.086785:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787848220.086822:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787848220.086856:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787848220.086881:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332736:0@lo:502: 00000100:00100000:0.0:1787848220.086927:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848220.086964:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff506e2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787848220.087154:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631332736 00000100:00100000:2.0:1787848220.087160:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631332736 00000100:00100000:2.0:1787848220.087262:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787848220.087272:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332736:12345-0@lo:502: 00000100:00100000:2.0:1787848220.087499:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332736:12345-0@lo:502: Request processed in 228us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848220.087506:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787848220.087692:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631332480:0@lo:103: 00000100:00100000:1.0:1787848220.087727:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848220.087812:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631332480 00000100:00100000:3.0:1787848220.087822:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631332480 00000100:00100000:3.0:1787848220.087856:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787848220.087863:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:3312:x1874694631332480:12345-0@lo:103: 00010000:00010000:3.0:1787848220.087875:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848220.087894:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb2fe expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.087909:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848220.087941:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:3312:x1874694631332480:12345-0@lo:103: Request processed in 79us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848220.087947:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787848220.087975:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631332480:0@lo:103: 00000100:00100000:0.0:1787848220.088287:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332736:0@lo:502: 00000040:00080000:0.0:1787848220.088397:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787848220.088408:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787848220.088958:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787848220.088966:0:6706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787848220.088972:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848220.088974:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787848220.089044:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787848220.089073:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93ff7fcc99d0) 00000020:00000080:3.0:1787848220.089163:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787848220.089173:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787848220.089309:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ff4314e000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787848220.089317:0:6706:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787848220.089325:0:6706:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aeb41e0543cb32f 00010000:00010000:2.0:1787848220.098584:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787848220.099083:0:6706:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787848220.105553:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787848220.106262:0:6706:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787848220.123351:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787848220.126944:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787848220.142372:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787848220.142385:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848220.142391:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848220.142393:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787848220.142397:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787848220.142401:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848220.142402:0:6706:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787848220.142405:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787848220.142411:0:6706:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787848220.142469:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848220.142472:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848220.142473:0:6706:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787848220.142477:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787848220.148460:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787848220.148506:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787848220.148520:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848220.148533:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848220.148542:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff4314e000 from 1 10000000:01000000:1.0:1787848220.148545:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787848220.148589:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848220.148596:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848220.148630:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848220.148682:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332864:0@lo:101: 00000100:00100000:1.0:1787848220.148749:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848220.148795:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463a66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848220.149323:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631332864 00000100:00100000:0.0:1787848220.149330:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631332864 00000100:00100000:0.0:1787848220.149378:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787848220.149388:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:6687:x1874694631332864:12345-0@lo:101: 00010000:00010000:0.0:1787848220.149401:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848220.149414:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40030200/0x9aeb41e0543cb33d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb336 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.149437:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40030200/0x9aeb41e0543cb33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb336 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.149448:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40030200/0x9aeb41e0543cb33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb336 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.149456:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030200, rc 0) 00000100:00100000:0.0:1787848220.149504:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332864:12345-0@lo:101: Request processed in 118us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848220.149511:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787848220.150740:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332864:0@lo:101: 00010000:00010000:1.0:1787848220.150760:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848220.150770:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848220.150875:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332992:0@lo:501: 00000100:00100000:1.0:1787848220.151066:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848220.151113:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463a66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848220.151189:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631332992 00000100:00100000:2.0:1787848220.151195:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631332992 00000100:00100000:2.0:1787848220.151254:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787848220.151263:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332992:12345-0@lo:501: 00000100:00100000:2.0:1787848220.151507:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631332992:12345-0@lo:501: Request processed in 245us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848220.151514:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787848220.151624:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631332992:0@lo:501: 00000100:00100000:1.0:1787848220.151818:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333120:0@lo:503: 00000100:00100000:1.0:1787848220.151858:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848220.151877:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463a66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848220.152002:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631333120 00000100:00100000:2.0:1787848220.152006:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631333120 00000100:00100000:2.0:1787848220.152041:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787848220.152049:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631333120:12345-0@lo:503: 00000100:00100000:2.0:1787848220.152196:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631333120:12345-0@lo:503: Request processed in 147us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848220.152203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787848220.152368:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333120:0@lo:503: 00000040:00080000:1.0:1787848220.152632:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787848220.156827:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333248:0@lo:502: 00000100:00100000:1.0:1787848220.157054:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848220.158276:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463a66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848220.158356:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631333248 00000100:00100000:2.0:1787848220.158363:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631333248 00000100:00100000:2.0:1787848220.158405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787848220.158421:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631333248:12345-0@lo:502: 00000100:00100000:2.0:1787848220.158721:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631333248:12345-0@lo:502: Request processed in 301us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848220.158729:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787848220.163258:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333248:0@lo:502: 00000040:00080000:1.0:1787848220.163708:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787848220.163784:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787848220.163829:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333376:0@lo:502: 00000100:00100000:1.0:1787848220.163917:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848220.163961:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463a66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848220.164294:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631333376 00000100:00100000:0.0:1787848220.164302:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631333376 00000100:00100000:0.0:1787848220.164360:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787848220.164370:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631333376:12345-0@lo:502: 00000100:00100000:0.0:1787848220.164556:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631333376:12345-0@lo:502: Request processed in 187us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848220.164564:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787848220.164810:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333376:0@lo:502: 00000040:00080000:1.0:1787848220.164931:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787848220.164943:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787848220.165625:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787848220.165635:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848220.165667:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787848220.165685:0:6710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ff4314e000 00000020:00000080:1.0:1787848220.165687:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787848220.165708:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787848220.165712:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848220.165713:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787848220.165716:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787848220.165892:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787848220.165923:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787848220.165939:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.165949:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848220.165996:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787848220.165999:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ff4314e000 10000000:01000000:2.0:1787848220.166002:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ff4314e000 10000000:01000000:2.0:1787848220.166006:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787848220.166013:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ff4314e000 from 1 10000000:01000000:2.0:1787848220.166016:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787848220.166048:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.166057:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.166067:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848220.166087:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333504:0@lo:101: 00000100:00100000:2.0:1787848220.166138:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848220.166181:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52c763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848220.166743:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631333504 00000100:00100000:0.0:1787848220.166751:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631333504 00000100:00100000:0.0:1787848220.166846:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787848220.166855:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631333504:12345-0@lo:101: 00010000:00010000:0.0:1787848220.166866:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848220.166880:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40030000/0x9aeb41e0543cb34b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb344 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.166971:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40030000/0x9aeb41e0543cb34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb344 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.167045:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40030000/0x9aeb41e0543cb34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb344 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848220.167054:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030000, rc 0) 00000100:00100000:0.0:1787848220.167154:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6687:x1874694631333504:12345-0@lo:101: Request processed in 299us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848220.167161:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787848220.171245:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333504:0@lo:101: 00010000:00010000:1.0:1787848220.171282:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848220.171296:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848220.171428:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333632:0@lo:501: 00000100:00100000:1.0:1787848220.171489:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848220.171576:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463a6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787848220.172475:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631333632 00000100:00100000:3.0:1787848220.172483:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631333632 00000100:00100000:3.0:1787848220.172563:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787848220.172573:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6687:x1874694631333632:12345-0@lo:501: 00000100:00100000:2.0:1787848220.173019:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333632:0@lo:501: 00000100:00100000:2.0:1787848220.173061:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333760:0@lo:503: 00000100:00100000:3.0:1787848220.173665:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6687:x1874694631333632:12345-0@lo:501: Request processed in 1092us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848220.173682:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787848220.174060:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848220.174102:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52c76c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787848220.174146:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631333760 00000100:00100000:0.0:1787848220.174162:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631333760 00000100:00100000:0.0:1787848220.174276:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787848220.174285:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6687:x1874694631333760:12345-0@lo:503: 00000100:00100000:0.0:1787848220.174470:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6687:x1874694631333760:12345-0@lo:503: Request processed in 186us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848220.174479:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787848220.174559:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333760:0@lo:503: 00000040:00080000:1.0:1787848220.175139:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787848220.175222:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333888:0@lo:502: 00000100:00100000:1.0:1787848220.175267:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848220.175297:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787848220.175364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631333888 00000100:00100000:0.0:1787848220.175370:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631333888 00000100:00100000:0.0:1787848220.175393:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787848220.175400:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6687:x1874694631333888:12345-0@lo:502: 00000100:00100000:0.0:1787848220.175574:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6687:x1874694631333888:12345-0@lo:502: Request processed in 174us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848220.175581:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787848220.175885:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631333888:0@lo:502: 00000040:00080000:1.0:1787848220.176306:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787848220.176360:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787848220.176395:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787848220.176444:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787848220.176495:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787848220.176545:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787848220.176583:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787848220.177466:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787848220.177550:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787848220.177591:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787848220.177684:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787848220.177738:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787848220.177776:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787848220.177812:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787848220.177861:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787848220.178212:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787848220.178248:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787848220.178297:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787848220.178331:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787848220.178364:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787848220.178427:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787848220.178469:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787848220.178505:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787848220.178554:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787848220.178593:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787848220.178865:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787848220.179090:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787848220.179131:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787848220.179182:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631334016:0@lo:502: 00000100:00100000:1.0:1787848220.179259:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848220.179366:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787848220.179516:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631334016 00000100:00100000:0.0:1787848220.179524:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631334016 00000100:00100000:0.0:1787848220.179576:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787848220.179586:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6687:x1874694631334016:12345-0@lo:502: 00000100:00100000:0.0:1787848220.188503:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6687:x1874694631334016:12345-0@lo:502: Request processed in 8910us (9234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848220.188518:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787848220.188832:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631334016:0@lo:502: 00000040:00080000:1.0:1787848220.189193:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787848220.189210:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787848220.189939:0:6711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787848220.189955:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93ff510333a0) 00000020:00000080:1.0:1787848220.189977:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787848220.190179:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ff4314e000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787848220.190183:0:6711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ff4314e000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787848220.190186:0:6711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ff4314e000 3 00010000:00080000:1.0:1787848220.190214:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93fe413b2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.126@tcp at head 00010000:00010000:1.0:1787848220.195864:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787848220.196399:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787848220.196438:0:6711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787848220.196451:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9aeb41e0543cb359 00000100:00080000:1.0:1787848220.196462:0:6711:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787848220.196468:0:6711:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93fe413b2000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:1.0:1787848220.196504:0:6711:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff55ae4000 x1874694631334144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787848220.196532:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787848220.196666:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874694631334144:0@lo:38: 00000100:00100000:2.0:1787848220.196752:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848220.197305:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631334144 00000100:00100000:0.0:1787848220.197312:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631334144 00000100:00100000:0.0:1787848220.197349:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787848220.197356:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874694631334144:12345-0@lo:38: 00010000:00080000:0.0:1787848220.197380:0:5844:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:0.0:1787848220.197412:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9aeb41e0543cb360 00000004:00100000:0.0:1787848220.197427:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787848220.197466:0:5844:0:(import.c:65:import_set_state_nolock()) ffff93ff8048f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787848220.197534:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874694631334144:12345-0@lo:38: Request processed in 177us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848220.197542:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787848220.197585:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ff55ae4000 x1874694631334144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787848230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848220.197596:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787848220.197764:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787848220.197772:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787848220.197776:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787848220.197780:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93fe413b2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787848220.197786:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874694631334144:0@lo:38: 00000040:00080000:1.0:1787848220.198945:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787848220.199356:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787848220.199382:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787848220.199398:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.199410:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787848220.199474:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787848220.199476:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787848220.199478:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848220.199479:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848220.199480:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848220.199481:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848220.199483:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848220.199485:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787848220.199486:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787848220.199488:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848220.199489:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787848220.199494:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787848220.199496:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787848220.199497:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787848220.199498:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848220.199499:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848220.199500:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848220.199501:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848220.199507:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848220.199508:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787848220.199509:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787848220.199510:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848220.199511:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787848220.199535:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787848220.199551:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631334272:0@lo:253: 00000100:00100000:2.0:1787848220.199626:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848220.199703:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52c76c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787848220.199788:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631334272 00000100:00100000:1.0:1787848220.199795:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631334272 00000100:00100000:1.0:1787848220.199841:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787848220.199858:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6687:x1874694631334272:12345-0@lo:253: 20000000:01000000:1.0:1787848220.199881:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787848220.199905:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787848220.204465:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631334400:0@lo:400: 00000100:00100000:3.0:1787848220.204546:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848220.204620:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631334400 00000100:00100000:3.0:1787848220.204628:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631334400 00000100:00100000:3.0:1787848220.204726:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787848220.204735:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631334400:12345-0@lo:400: 00000100:00100000:3.0:1787848220.204790:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631334400:12345-0@lo:400: Request processed in 56us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848220.204797:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787848220.204839:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ff55bdc000 x1874694631334400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848220.204854:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631334400:0@lo:400: 20000000:01000000:1.0:1787848220.265489:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787848220.265507:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787848220.265563:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787848220.265569:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787848220.265590:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.265628:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff413a1000/0x9aeb41e0543cb2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb2bf expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.265657:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.265713:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff413a1000/0x9aeb41e0543cb2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb2bf expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.265728:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff413a1000/0x9aeb41e0543cb2c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb2bf expref: 13 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848220.265746:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874694631334528:0@lo:104: 00000100:00100000:3.0:1787848220.265815:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848220.266441:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe410b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787848220.276873:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631334528 00000100:00100000:1.0:1787848220.276886:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631334528 00000100:00100000:1.0:1787848220.276962:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787848220.276973:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5858:x1874694631334528:12345-0@lo:104: 00010000:00010000:1.0:1787848220.277000:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb2bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848220.277148:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787848220.277155:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5858:x1874694631334528:12345-0@lo:104: Request processed in 185us (11340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848220.277163:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787848220.277183:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848220.277189:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb2bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848220.277198:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030400 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848220.277202:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb2bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848220.277211:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb2bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848220.277218:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb2bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848220.277243:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787848220.277283:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb2bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848220.277289:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848220.277309:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb2bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848220.277317:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb2bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb2c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848220.277336:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848220.277338:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848220.277340:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848220.279193:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631334656:0@lo:103: 00000100:00100000:1.0:1787848220.279271:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848220.279382:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631334656 00000100:00100000:2.0:1787848220.279390:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631334656 00010000:00010000:2.0:1787848220.279420:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff413a1000/0x9aeb41e0543cb2c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb2bf expref: 14 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848220.279456:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787848220.279463:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff50bb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:3311:x1874694631334656:12345-0@lo:103: 00010000:00010000:2.0:1787848220.279475:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848220.279481:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff413a1000/0x9aeb41e0543cb2c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb2bf expref: 14 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.279494:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff413a1000/0x9aeb41e0543cb2c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb2bf expref: 14 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.279514:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.279523:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787848220.279537:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013969231s 00010000:00010000:2.0:1787848220.279542:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.279567:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.279573:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.279580:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.279586:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c6000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848220.279589:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.279596:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.279605:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848220.279614:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848220.279698:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff50bb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:3311:x1874694631334656:12345-0@lo:103: Request processed in 235us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848220.279706:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787848220.279873:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631334656:0@lo:103: 00010000:00010000:3.0:1787848220.281115:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff413a1000/0x9aeb41e0543cb2c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb2bf expref: 13 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848220.281131:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874694631334528:0@lo:104: 00010000:00010000:3.0:1787848220.281149:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.281159:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.281164:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848220.281169:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb367 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848220.291742:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:6687:x1874694631334272:12345-0@lo:253: Request processed in 91876us (92106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848220.291759:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787848220.291887:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6687:1874694631334272:0@lo:253: 10000000:01000000:3.0:1787848220.291921:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787848220.291925:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787848220.291927:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787848220.291928:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787848220.291929:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787848220.291931:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787848220.291932:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787848220.291934:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787848220.291935:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787848220.291936:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787848220.291938:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787848220.291939:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787848220.291957:0:6687:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787848220.299535:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787848220.299786:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787848220.300514:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787848220.300777:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787848220.302254:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848220.302529:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787848220.304089:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787848220.525329:0:6687:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787848220.525336:0:6687:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787848220.525370:0:6687:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787848220.525421:0:6687:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787848220.525444:0:6687:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787848220.525470:0:6687:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787848220.662910:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848221.687715:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848222.705571:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848223.729033:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787848224.048079:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787848224.048086:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ff506b3000 from 21 10000000:01000000:1.0:1787848224.048091:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787848224.048137:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.048159:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.048170:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848224.048204:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631334784:0@lo:101: 00000100:00100000:1.0:1787848224.048277:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848224.048329:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631334784 00000100:00100000:0.0:1787848224.048338:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631334784 00000100:00100000:0.0:1787848224.048390:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787848224.048400:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5839:x1874694631334784:12345-0@lo:101: 00010000:00010000:0.0:1787848224.048416:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848224.048430:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb36e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848224.048453:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb36e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848224.048463:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb36e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848224.048464:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7d80 going to sleep for 11 seconds 00010000:00010000:0.0:1787848224.048484:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030600, rc 0) 00000100:00100000:0.0:1787848224.048534:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631334784:12345-0@lo:101: Request processed in 135us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848224.048542:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787848224.048744:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631334784:0@lo:101: 00010000:00010000:1.0:1787848224.048759:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.048768:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848224.048822:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631334912:0@lo:501: 00000100:00100000:1.0:1787848224.048846:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848224.049856:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631334912 00000100:00100000:3.0:1787848224.049875:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631334912 00000100:00100000:3.0:1787848224.050092:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787848224.050102:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631334912:12345-0@lo:501: 00000100:00100000:3.0:1787848224.050717:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631334912:12345-0@lo:501: Request processed in 615us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848224.050725:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787848224.054494:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848224.054548:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631334912:0@lo:501: 00000100:00100000:1.0:1787848224.054630:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335040:0@lo:503: 00000100:00100000:1.0:1787848224.054743:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848224.054790:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848224.054814:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631335040 00000100:00100000:1.0:1787848224.054819:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631335040 00000100:00100000:1.0:1787848224.054871:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787848224.054890:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631335040:12345-0@lo:503: 00000100:00100000:1.0:1787848224.055488:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631335040:12345-0@lo:503: Request processed in 598us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848224.055496:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787848224.055611:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335040:0@lo:503: 00000100:00100000:0.0:1787848224.057802:0:6875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6875:1874694631335168:0@lo:502: 00000100:00100000:0.0:1787848224.057910:0:6875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848224.058097:0:6875:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6f8ead80 going to sleep for 11 seconds 00000100:00100000:3.0:1787848224.058182:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631335168 00000100:00100000:3.0:1787848224.058196:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631335168 00000100:00100000:3.0:1787848224.058236:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787848224.058245:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6875:x1874694631335168:12345-0@lo:502: 00000100:00100000:3.0:1787848224.058797:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6875:x1874694631335168:12345-0@lo:502: Request processed in 552us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848224.058807:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787848224.059124:0:6875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6875:1874694631335168:0@lo:502: 00000100:00100000:0.0:1787848224.059174:0:6875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6875:1874694631335296:0@lo:502: 00000100:00100000:0.0:1787848224.059218:0:6875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848224.059240:0:6875:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52374240 going to sleep for 11 seconds 00000100:00100000:3.0:1787848224.059359:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631335296 00000100:00100000:3.0:1787848224.059364:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631335296 00000100:00100000:3.0:1787848224.059501:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787848224.059508:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6875:x1874694631335296:12345-0@lo:502: 00000100:00100000:3.0:1787848224.059684:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:6875:x1874694631335296:12345-0@lo:502: Request processed in 176us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848224.059691:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787848224.059871:0:6875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6875:1874694631335296:0@lo:502: 00000040:00080000:0.0:1787848224.059890:0:6875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787848224.060835:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787848224.061253:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787848224.061266:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.061278:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848224.061288:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787848224.061290:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ff506b3000 from 4 10000000:01000000:1.0:1787848224.061293:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787848224.061329:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.061336:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.061347:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848224.061365:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335424:0@lo:101: 00000100:00100000:1.0:1787848224.062059:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848224.062155:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7300 going to sleep for 11 seconds 00000100:00100000:3.0:1787848224.066386:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631335424 00000100:00100000:3.0:1787848224.066403:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631335424 00000100:00100000:3.0:1787848224.066465:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787848224.066475:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631335424:12345-0@lo:101: 00010000:00010000:3.0:1787848224.066494:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848224.066518:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb383 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb37c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848224.066549:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb37c expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848224.066563:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb37c expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848224.066572:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c7800, rc 0) 00000100:00100000:3.0:1787848224.066698:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631335424:12345-0@lo:101: Request processed in 224us (4639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848224.066705:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787848224.066936:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335424:0@lo:101: 00010000:00010000:1.0:1787848224.066957:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.066975:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848224.067036:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335552:0@lo:256: 00000100:00100000:1.0:1787848224.067076:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848224.067117:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787848224.067235:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631335552 00000100:00100000:0.0:1787848224.067241:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631335552 00000100:00100000:0.0:1787848224.067275:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787848224.067283:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631335552:12345-0@lo:256: 20000000:01000000:0.0:1787848224.067297:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787848224.067314:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787848224.067317:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787848224.067397:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631335552:12345-0@lo:256: Request processed in 114us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848224.067404:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787848224.067777:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335552:0@lo:256: 10000000:01000000:1.0:1787848224.067821:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787848224.067829:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.067839:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848224.067849:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787848224.067861:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787848224.067865:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787848224.067888:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.067904:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.067918:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848224.067931:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335680:0@lo:101: 00000100:00100000:1.0:1787848224.067964:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848224.067986:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787848224.067998:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631335680 00000100:00100000:1.0:1787848224.068002:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631335680 00000100:00100000:1.0:1787848224.068024:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787848224.068031:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631335680:12345-0@lo:101: 00010000:00010000:1.0:1787848224.068040:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848224.068048:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff414a5c00/0x9aeb41e0543cb391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb38a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.068065:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff414a5c00/0x9aeb41e0543cb391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb38a expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.068075:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff414a5c00/0x9aeb41e0543cb391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb38a expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.068082:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff414a5c00, rc 0) 00000100:00100000:1.0:1787848224.068108:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631335680:12345-0@lo:101: Request processed in 77us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848224.068114:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787848224.068140:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335680:0@lo:101: 00010000:00010000:1.0:1787848224.068149:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.068157:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848224.068212:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335808:0@lo:501: 00000100:00100000:1.0:1787848224.068242:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848224.068256:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787848224.068266:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631335808 00000100:00100000:1.0:1787848224.068269:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631335808 00000100:00100000:1.0:1787848224.068289:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787848224.068295:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631335808:12345-0@lo:501: 00000100:00100000:1.0:1787848224.068541:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631335808:12345-0@lo:501: Request processed in 246us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848224.068548:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787848224.068578:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335808:0@lo:501: 00000100:00100000:1.0:1787848224.068611:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335936:0@lo:503: 00000100:00100000:1.0:1787848224.068674:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848224.068693:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787848224.068702:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631335936 00000100:00100000:1.0:1787848224.068705:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631335936 00000100:00100000:1.0:1787848224.068723:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787848224.068728:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631335936:12345-0@lo:503: 00000100:00100000:1.0:1787848224.069008:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631335936:12345-0@lo:503: Request processed in 278us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848224.069014:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787848224.069050:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631335936:0@lo:503: 00000100:00100000:0.0:1787848224.071513:0:6876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6876:1874694631336064:0@lo:502: 00000100:00100000:0.0:1787848224.071590:0:6876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848224.071662:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631336064 00000100:00100000:0.0:1787848224.071664:0:6876:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff51db1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787848224.071669:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631336064 00000100:00100000:3.0:1787848224.071722:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787848224.071732:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:6876:x1874694631336064:12345-0@lo:502: 00000100:00100000:3.0:1787848224.072035:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:6876:x1874694631336064:12345-0@lo:502: Request processed in 304us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848224.072043:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787848224.072144:0:6876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6876:1874694631336064:0@lo:502: 00000020:01000000:0.0:1787848224.072172:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787848224.072192:0:6876:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787848224.072199:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848224.072201:0:6876:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787848224.072206:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787848224.072209:0:6876:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.126@tcp to nid 0x20000c0a8c97e (192.168.201.126@tcp) 00000020:01000000:0.0:1787848224.072242:0:6876:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787848224.072246:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787848224.072261:0:6876:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93ff520acd70) 00000020:00000080:0.0:1787848224.072281:0:6876:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787848224.072287:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787848224.072354:0:6876:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787848224.072359:0:6876:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787848224.072368:0:6876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cb39f 00010000:00080000:0.0:1787848224.072397:0:6876:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ff515f6800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:0.0:1787848224.072630:0:6876:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787848224.164741:0:6876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787848224.164764:0:6876:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787848224.165337:0:6876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787848224.165511:0:6876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787848224.165561:0:6876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787848224.165673:0:6876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787848224.169104:0:6882:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787848224.169117:0:6882:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787848224.170533:0:6876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787848224.170551:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787848224.170589:0:6876:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787848224.173451:0:6876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aeb41e0543cb3a6 00000100:00080000:1.0:1787848224.173466:0:6876:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787848224.173474:0:6876:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ff515f6800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:1.0:1787848224.173518:0:6876:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff55ae7480 x1874694631336192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787848224.173546:0:6876:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787848224.173659:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787848224.173667:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848224.173670:0:6876:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787848224.173673:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787848224.173679:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848224.173681:0:6876:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787848224.173684:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787848224.173687:0:6876:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787848224.173719:0:6876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6876:1874694631336320:0@lo:502: 00000100:00100000:1.0:1787848224.173800:0:6876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848224.173850:0:6876:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787848224.173920:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631336320 00000100:00100000:1.0:1787848224.173927:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631336320 00000100:00100000:1.0:1787848224.173972:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787848224.173981:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:6876:x1874694631336320:12345-0@lo:502: 00000100:00100000:3.0:1787848224.174292:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631336192:0@lo:8: 00000100:00100000:3.0:1787848224.174332:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848224.174377:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631336192 00000100:00100000:3.0:1787848224.174380:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631336192 00000100:00100000:3.0:1787848224.174404:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787848224.174409:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874694631336192:12345-0@lo:8: 00010000:00080000:3.0:1787848224.174430:0:6689:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:3.0:1787848224.174459:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aeb41e0543cb3ad 00002000:00100000:3.0:1787848224.174501:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93fe4134f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113956 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787848224.174506:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787848224.174511:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787848224.174657:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787848224.174803:0:6689:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787848224.174826:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93fe41349800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787848224.174874:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874694631336192:12345-0@lo:8: Request processed in 463us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848224.174882:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787848224.174920:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff55ae7480 x1874694631336192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787848234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848224.174930:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787848224.174946:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787848224.174954:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787848224.174958:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787848224.174961:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff515f6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787848224.174972:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787848224.174977:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631336192:0@lo:8: 00000100:00100000:1.0:1787848224.175299:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:6876:x1874694631336320:12345-0@lo:502: Request processed in 1318us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848224.175308:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787848224.175357:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631336448:0@lo:400: 00000100:00100000:1.0:1787848224.175387:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848224.175412:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787848224.175418:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631336576:0@lo:400: 00000100:00100000:1.0:1787848224.175467:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848224.175506:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631336448 00000100:00100000:1.0:1787848224.175511:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631336448 00000100:00100000:1.0:1787848224.175539:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631336576 00000100:00100000:1.0:1787848224.175542:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631336576 00000100:00100000:1.0:1787848224.175568:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787848224.175576:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631336448:12345-0@lo:400: 00000100:00100000:1.0:1787848224.175626:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631336448:12345-0@lo:400: Request processed in 50us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848224.175631:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787848224.175659:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787848224.175667:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631336576:12345-0@lo:400: 00000100:00100000:1.0:1787848224.175693:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631336576:12345-0@lo:400: Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848224.175699:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787848224.175719:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787848224.175736:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff55ae43c0 x1874694631336576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848224.175747:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631336576:0@lo:400: 00010000:00080000:1.0:1787848224.175755:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff55ae6580 x1874694631336448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848224.175763:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631336448:0@lo:400: 00000004:00080000:1.0:1787848224.175786:0:6882:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787848224.175899:0:6882:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173087258573ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787848224.177360:0:6876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:6876:1874694631336320:0@lo:502: 00000020:01000000:3.0:1787848224.177408:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848224.177417:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848224.177419:0:6876:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787848224.177424:0:6876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787848224.177567:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787848224.177588:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787848224.177597:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848224.177619:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848224.177629:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787848224.177632:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93ff520ab3a0 from 1 10000000:01000000:3.0:1787848224.177634:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787848224.177688:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848224.177696:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848224.177706:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848224.177732:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631336704:0@lo:101: 00000100:00100000:3.0:1787848224.177788:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848224.178139:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff460eb000 going to sleep for 11 seconds 00000100:00100000:0.0:1787848224.178410:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631336704 00000100:00100000:0.0:1787848224.178418:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631336704 00000100:00100000:0.0:1787848224.179207:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787848224.179223:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631336704:12345-0@lo:101: 00010000:00010000:0.0:1787848224.179242:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848224.179263:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cb3bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb3b4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848224.179290:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cb3bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb3b4 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848224.179312:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cb3bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb3b4 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848224.179322:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40031600, rc 0) 00000100:00100000:0.0:1787848224.182337:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631336704:12345-0@lo:101: Request processed in 3112us (4540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848224.182349:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787848224.182536:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631336704:0@lo:101: 00010000:00010000:1.0:1787848224.182562:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.182586:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848224.182752:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631336832:0@lo:501: 00000100:00100000:1.0:1787848224.182810:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848224.183036:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787848224.183147:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631336832 00000100:00100000:0.0:1787848224.183155:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631336832 00000100:00100000:0.0:1787848224.183209:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787848224.183218:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631336832:12345-0@lo:501: 00000100:00100000:0.0:1787848224.183435:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631336832:12345-0@lo:501: Request processed in 218us (624us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787848224.183443:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787848224.187021:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631336832:0@lo:501: 10000000:01000000:1.0:1787848224.187080:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787848224.187091:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848224.187102:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787848224.218447:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787848224.251516:0:6883:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787848224.251551:0:6883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874694631337088:0@lo:7: 00000100:00100000:2.0:1787848224.251688:0:6883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848224.251745:0:6883:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe410b23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848224.251811:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787848224.251824:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631336960:0@lo:13: 00000100:00100000:0.0:1787848224.251861:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848224.251918:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631337088 00000100:00100000:0.0:1787848224.251926:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631337088 00000100:00100000:0.0:1787848224.251978:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787848224.251988:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6883:x1874694631337088:12345-0@lo:7: 00000100:00100000:2.0:1787848224.254550:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631336960 00000100:00100000:2.0:1787848224.254561:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631336960 00000100:00100000:2.0:1787848224.254618:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787848224.254628:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874694631336960:12345-0@lo:13: 00002000:00000024:2.0:1787848224.254677:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787848224.254764:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874694631336960:12345-0@lo:13: Request processed in 137us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848224.254772:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787848224.258163:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff58d0a1c0 x1874694631336960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848224.258205:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631336960:0@lo:13: 00000100:00080000:1.0:1787848224.259298:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1787848224.261340:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787848224.261349:0:6691:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787848224.261454:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6883:x1874694631337088:12345-0@lo:7: Request processed in 9464us (9763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848224.261465:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787848224.261524:0:6883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff58d0b480 x1874694631337088/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787848240 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848224.261540:0:6883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874694631337088:0@lo:7: 00000004:00080000:2.0:1787848224.261552:0:6883:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787848224.261587:0:6883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874694631337216:0@lo:5: 00000100:00100000:2.0:1787848224.261634:0:6883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848224.261722:0:6883:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe410b23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848224.261810:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631337216 00000100:00100000:0.0:1787848224.261822:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631337216 00000100:00100000:0.0:1787848224.261866:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787848224.261875:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6883:x1874694631337216:12345-0@lo:5: 00002000:00080000:0.0:1787848224.261899:0:6690:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787848224.261902:0:6690:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787848224.262085:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6883:x1874694631337216:12345-0@lo:5: Request processed in 210us (450us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787848224.262092:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787848224.262117:0:6883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff58d0b480 x1874694631337216/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787848240 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848224.262129:0:6883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874694631337216:0@lo:5: 00000004:00080000:3.0:1787848224.262138:0:6883:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787848224.262161:0:6883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdcb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874694631337344:0@lo:700: 00000100:00100000:3.0:1787848224.262189:0:6883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848224.262212:0:6883:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff460eb180 going to sleep for 11 seconds 00000100:00100000:1.0:1787848224.262268:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631337344 00000100:00100000:1.0:1787848224.262274:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631337344 00000100:00100000:1.0:1787848224.262308:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787848224.262316:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6883:x1874694631337344:12345-0@lo:700: 00000100:00100000:1.0:1787848224.262343:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6698:1874694631337472:0@lo:700: 00000100:00100000:1.0:1787848224.262372:0:6698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848224.262396:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787848224.262454:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631337472 00000100:00100000:0.0:1787848224.262458:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631337472 00000100:00100000:0.0:1787848224.262482:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848224.262488:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6698:x1874694631337472:12345-0@lo:700: 40000000:02000000:2.0:1787848224.306029:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787848224.318664:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6698:x1874694631337472:12345-0@lo:700: Request processed in 56146us (56261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848224.318682:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787848224.318938:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff55ae6580 x1874694631337472/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787848240 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848224.318955:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6698:1874694631337472:0@lo:700: 40000000:02000000:1.0:1787848224.318984:0:6698:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1787848224.437149:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6883:x1874694631337344:12345-0@lo:700: Request processed in 174823us (174947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848224.437173:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787848224.437843:0:6883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff55bdcb40 x1874694631337344/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787848240 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848224.437874:0:6883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdcb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874694631337344:0@lo:700: 00000001:00080000:1.0:1787848224.442178:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787848224.442216:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1787848224.504737:0:6883:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787848224.519506:0:6883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdcb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874694631337600:0@lo:5: 00000100:00100000:3.0:1787848224.519578:0:6883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848224.519687:0:6883:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848224.519958:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631337600 00000100:00100000:1.0:1787848224.519967:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631337600 00000100:00100000:1.0:1787848224.520017:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787848224.520028:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6883:x1874694631337600:12345-0@lo:5: 00002000:00080000:3.0:1787848224.538582:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787848224.538616:0:6691:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787848224.550781:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6883:x1874694631337600:12345-0@lo:5: Request processed in 30743us (31190us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787848224.550804:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787848224.551559:0:6883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff55bdcb40 x1874694631337600/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787848240 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848224.551578:0:6883:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787848224.551606:0:6883:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93ff55bdcb40 x1874694631337600/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787848240 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848224.551619:0:6883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdcb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874694631337600:0@lo:5: 00000004:00080000:1.0:1787848224.551635:0:6883:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787848224.752535:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848225.776139:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848226.801348:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848227.827363:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787848228.263483:0:7059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787848228.855711:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848229.232118:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631338112:0@lo:400: 00000100:00100000:3.0:1787848229.232209:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848229.232270:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787848229.232276:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631337728:0@lo:400: 00000100:00100000:3.0:1787848229.232305:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848229.232338:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631337856:0@lo:400: 00000100:00100000:3.0:1787848229.232363:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848229.232382:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848229.232387:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631337984:0@lo:400: 00000100:00100000:3.0:1787848229.232411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848229.232444:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631338112 00000100:00100000:3.0:1787848229.232452:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631338112 00000100:00100000:3.0:1787848229.232507:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787848229.232526:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631338112:12345-0@lo:400: 00000100:00100000:3.0:1787848229.232578:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631338112:12345-0@lo:400: Request processed in 64us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848229.232585:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787848229.232607:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631337728 00000100:00100000:3.0:1787848229.232611:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631337728 00000100:00100000:3.0:1787848229.232636:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787848229.232670:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3310:x1874694631337728:12345-0@lo:400: 00000100:00100000:3.0:1787848229.232701:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3310:x1874694631337728:12345-0@lo:400: Request processed in 32us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848229.232706:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787848229.232733:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631337856 00000100:00100000:3.0:1787848229.232743:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631337856 00000100:00100000:3.0:1787848229.232768:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631337984 00000100:00100000:3.0:1787848229.232772:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631337984 00000100:00100000:3.0:1787848229.232790:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787848229.232795:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631337856:12345-0@lo:400: 00000100:00100000:3.0:1787848229.232830:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631337856:12345-0@lo:400: Request processed in 35us (466us total) trans 0 rc 0/0 00000100:00080000:2.0:1787848229.234248:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787848229.234256:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848229.234271:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787848229.234281:0:5843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787848229.234771:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787848229.234797:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787848229.234987:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631337984:12345-0@lo:400: 00000100:00100000:3.0:1787848229.235054:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631337984:12345-0@lo:400: Request processed in 250us (2641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848229.235061:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787848229.235103:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff55bde1c0 x1874694631337984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848229.235116:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631337984:0@lo:400: 00010000:00080000:3.0:1787848229.235129:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff55bdc000 x1874694631337856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848229.235137:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631337856:0@lo:400: 00000100:00100000:2.0:1787848229.235865:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631337728:0@lo:400: 00010000:00080000:2.0:1787848229.235893:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff55bdd680 x1874694631338112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848229.235905:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631338112:0@lo:400: 00000100:00100000:1.0:1787848229.748245:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631338240:0@lo:13: 00000100:00100000:1.0:1787848229.748319:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848229.748601:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631338240 00000100:00100000:2.0:1787848229.748611:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631338240 00000100:00100000:2.0:1787848229.748677:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787848229.748688:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874694631338240:12345-0@lo:13: 00002000:00000024:2.0:1787848229.748722:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848229.748769:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874694631338240:12345-0@lo:13: Request processed in 84us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848229.748776:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787848229.750111:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff55ae7c00 x1874694631338240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848229.750134:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631338240:0@lo:13: 00010000:00010000:2.0:1787848229.875524:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787848229.936582:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787848230.895863:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848231.920208:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848232.959375:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848233.971798:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848234.359992:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631338368:0@lo:400: 00000100:00100000:1.0:1787848234.360079:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848234.360748:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631338368 00000100:00100000:2.0:1787848234.360757:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631338368 00000100:00100000:2.0:1787848234.360810:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787848234.360818:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3312:x1874694631338368:12345-0@lo:400: 00000100:00100000:2.0:1787848234.372717:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3312:x1874694631338368:12345-0@lo:400: Request processed in 11886us (12625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848234.372751:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787848234.375781:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631338496:0@lo:400: 00000100:00100000:0.0:1787848234.375865:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848234.378870:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631338368:0@lo:400: 00000100:00100000:2.0:1787848234.379864:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631338496 00000100:00100000:2.0:1787848234.379875:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631338496 00000100:00100000:2.0:1787848234.379977:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848234.379987:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631338496:12345-0@lo:400: 00000100:00100000:2.0:1787848234.380086:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631338496:12345-0@lo:400: Request processed in 100us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848234.380092:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787848234.380156:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff559b1e00 x1874694631338496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848234.380170:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631338496:0@lo:400: 00000100:00100000:0.0:1787848234.387376:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631338752:0@lo:400: 00000100:00100000:0.0:1787848234.387476:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848234.387549:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787848234.387557:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631338624:0@lo:400: 00000100:00100000:0.0:1787848234.387586:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848234.387654:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631338752 00000100:00100000:1.0:1787848234.387678:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631338752 00000100:00100000:1.0:1787848234.387741:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787848234.387750:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631338752:12345-0@lo:400: 00000100:00100000:1.0:1787848234.387802:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631338752:12345-0@lo:400: Request processed in 53us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848234.387808:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787848234.398166:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff559b0000 x1874694631338752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848234.398183:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787848234.398203:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631338752:0@lo:400: 00000100:00100000:3.0:1787848234.398461:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631338624 00000100:00100000:3.0:1787848234.398469:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631338624 00000100:00100000:3.0:1787848234.398728:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787848234.398740:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631338624:12345-0@lo:400: 00000100:00100000:3.0:1787848234.398824:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631338624:12345-0@lo:400: Request processed in 87us (11236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848234.398832:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787848234.399058:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff559b1680 x1874694631338624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848234.399071:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631338624:0@lo:400: 00000100:00080000:2.0:1787848234.399463:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787848234.399469:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787848234.870299:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631338880:0@lo:13: 00000100:00100000:3.0:1787848234.870373:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848234.870460:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631338880 00000100:00100000:3.0:1787848234.870467:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631338880 00000100:00100000:3.0:1787848234.870512:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787848234.870521:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631338880:12345-0@lo:13: 00002000:00000024:3.0:1787848234.870554:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848234.870598:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631338880:12345-0@lo:13: Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848234.870605:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787848234.870677:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff805c4780 x1874694631338880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848234.870698:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631338880:0@lo:13: 00010000:00010000:0.0:1787848234.992908:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848236.016104:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848237.039826:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848238.066518:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848239.087756:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848239.472148:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631339392:0@lo:400: 00000100:00100000:3.0:1787848239.472247:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848239.472315:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848239.472322:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631339008:0@lo:400: 00000100:00100000:3.0:1787848239.472366:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848239.472401:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631339264:0@lo:400: 00000100:00100000:3.0:1787848239.472428:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848239.472448:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787848239.472454:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631339136:0@lo:400: 00000100:00100000:3.0:1787848239.472490:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848239.472518:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631339008 00000100:00100000:3.0:1787848239.472525:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631339008 00000100:00100000:3.0:1787848239.472570:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787848239.472578:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3312:x1874694631339008:12345-0@lo:400: 00000100:00100000:3.0:1787848239.472626:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3312:x1874694631339008:12345-0@lo:400: Request processed in 49us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848239.472633:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787848239.472699:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631339264 00000100:00100000:3.0:1787848239.472703:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631339264 00000100:00100000:3.0:1787848239.472737:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631339136 00000100:00100000:3.0:1787848239.472739:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631339136 00000100:00100000:3.0:1787848239.472762:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787848239.472769:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631339264:12345-0@lo:400: 00000100:00100000:3.0:1787848239.472805:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631339264:12345-0@lo:400: Request processed in 36us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848239.472811:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787848239.472823:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787848239.472830:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631339136:12345-0@lo:400: 00000100:00100000:3.0:1787848239.472856:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631339136:12345-0@lo:400: Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848239.472862:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787848239.472907:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff58d0a580 x1874694631339136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848239.472922:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631339136:0@lo:400: 00010000:00080000:3.0:1787848239.472933:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff58d0ad00 x1874694631339264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848239.472949:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631339264:0@lo:400: 00000100:00100000:3.0:1787848239.472999:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631339008:0@lo:400: 00000100:00100000:2.0:1787848239.473443:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631339392 00000100:00100000:2.0:1787848239.473449:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631339392 00000100:00100000:2.0:1787848239.473491:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787848239.473500:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631339392:12345-0@lo:400: 00000100:00100000:2.0:1787848239.473545:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631339392:12345-0@lo:400: Request processed in 47us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848239.473551:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787848239.473569:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787848239.473573:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787848239.473770:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff58d08f00 x1874694631339392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848239.473782:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631339392:0@lo:400: 00000100:00100000:0.0:1787848239.983941:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631339520:0@lo:13: 00000100:00100000:0.0:1787848239.984029:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848239.984244:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631339520 00000100:00100000:3.0:1787848239.984254:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631339520 00000100:00100000:3.0:1787848239.984310:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848239.984320:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631339520:12345-0@lo:13: 00002000:00000024:3.0:1787848239.984370:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848239.984436:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631339520:12345-0@lo:13: Request processed in 118us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848239.984444:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787848239.984628:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff805c6940 x1874694631339520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848239.984697:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631339520:0@lo:13: 00010000:00010000:0.0:1787848240.112015:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848241.135810:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848242.161921:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787848242.758433:0:7642:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787848242.758439:0:7642:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787848242.758765:0:7642:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93fe41342800 00000020:01000004:2.0:1787848242.758785:0:7642:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787848242.758798:0:7642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787848242.758812:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93ff6ee6cd70) 00000020:00000080:2.0:1787848242.758830:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787848242.790490:0:7642:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787848242.791313:0:7642:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787848242.863530:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787848242.876750:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787848242.876796:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787848242.876856:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787848242.876885:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787848242.877245:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787848242.877258:0:7642:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787848242.877269:0:7642:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aeb41e0543cb3c9 00000020:01000004:2.0:1787848242.877292:0:7642:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787848242.877317:0:7642:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787848242.877321:0:7642:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787848242.877327:0:7642:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787848242.877352:0:7642:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787848242.877356:0:7642:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787848242.941896:0:7642:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787848242.941941:0:7642:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.126@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787848242.941946:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787848242.941947:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787848242.941949:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848242.941950:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848242.941951:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848242.941952:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848242.941953:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848242.941955:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787848242.941956:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787848242.941958:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848242.941959:0:7642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787848242.941962:0:7642:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787848242.941964:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787848242.941965:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787848242.941966:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848242.941967:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848242.941968:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848242.941969:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848242.941970:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848242.941983:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787848242.941989:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787848242.941990:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848242.941991:0:7642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787848242.942033:0:7642:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787848242.942051:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631339648:0@lo:253: 00000100:00100000:2.0:1787848242.942124:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848242.942187:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813ac240 going to sleep for 11 seconds 00000100:00100000:3.0:1787848242.942479:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631339648 00000100:00100000:3.0:1787848242.942488:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631339648 00000100:00100000:3.0:1787848242.942535:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787848242.942543:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:7642:x1874694631339648:12345-0@lo:253: 20000000:01000000:3.0:1787848242.942581:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787848242.942585:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787848242.942591:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787848242.942594:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787848242.943633:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787848242.943895:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787848242.943912:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787848242.943952:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787848242.943959:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787848242.943987:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787848242.944035:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787848242.944438:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787848242.944459:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.126@tcp 20000000:01000000:3.0:1787848242.944461:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.126@tcp (null) (null) (null) 00000040:00080000:3.0:1787848242.944494:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787848242.944502:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787848242.944557:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787848242.944566:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.126@tcp (null) (null) 00000040:00080000:3.0:1787848242.944601:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787848242.944610:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787848242.944681:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787848242.944736:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787848242.947990:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787848242.948091:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.126@tcp 20000000:01000000:2.0:1787848242.948094:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.126@tcp (null) (null) (null) 00000040:00080000:2.0:1787848242.948133:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1787848242.948141:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787848242.948319:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1787848242.948407:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.126@tcp (null) (null) 00000040:00080000:2.0:1787848242.948537:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1787848242.948550:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787848242.948603:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1787848242.948688:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1787848242.948713:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1787848242.948716:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1787848242.948723:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787848242.948725:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787848242.948727:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787848242.948741:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787848242.948744:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787848242.948784:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787848242.948787:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787848242.956877:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787848242.956976:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787848242.957047:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787848242.959384:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787848242.959443:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787848242.959480:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787848242.959496:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787848242.959499:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787848242.964605:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787848242.965330:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787848242.965381:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787848242.965460:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787848242.965475:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787848242.965478:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787848242.968316:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787848242.968409:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787848242.968468:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787848242.968999:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787848242.969044:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787848242.969120:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787848242.969137:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787848242.969140:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787848242.973969:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787848242.974085:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787848242.974121:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787848242.974855:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787848242.974904:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787848242.974963:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1787848242.974982:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787848242.975003:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975032:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb31a expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975039:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff40030000/0x9aeb41e0543cb34b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb344 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975045:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb36e expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975051:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff414a5c00/0x9aeb41e0543cb391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb38a expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975057:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cb3bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb3b4 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975065:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975102:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cb3bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb3b4 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975117:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cb3bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb3b4 expref: 16 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848242.975131:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874694631339776:0@lo:104: 00000100:00100000:2.0:1787848242.975198:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787848242.975303:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff414a5c00/0x9aeb41e0543cb391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb38a expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975312:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff414a5c00/0x9aeb41e0543cb391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb38a expref: 16 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848242.975328:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874694631339904:0@lo:104: 00010000:00010000:2.0:1787848242.975356:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb36e expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975364:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb36e expref: 16 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848242.975372:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874694631340032:0@lo:104: 00010000:00010000:2.0:1787848242.975394:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff40030000/0x9aeb41e0543cb34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb344 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975402:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff40030000/0x9aeb41e0543cb34b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb344 expref: 16 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848242.975410:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874694631340160:0@lo:104: 00010000:00010000:2.0:1787848242.975432:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb31a expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848242.975439:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb31a expref: 16 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848242.975446:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874694631340288:0@lo:104: 00000100:00100000:2.0:1787848242.975464:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1787848242.977420:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787848242.977466:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848242.977510:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848242.977521:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848242.977532:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848242.977547:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631339776 00000100:00100000:1.0:1787848242.977566:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631339776 00000100:00100000:1.0:1787848242.977619:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631339904 00000100:00100000:1.0:1787848242.977622:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631339904 00000100:00100000:1.0:1787848242.977633:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631340032 00000100:00100000:1.0:1787848242.977635:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631340032 00000100:00100000:3.0:1787848242.977813:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631340160 00000100:00100000:3.0:1787848242.977818:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631340160 00000100:00100000:3.0:1787848242.977836:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631340288 00000100:00100000:3.0:1787848242.977839:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631340288 00000100:00100000:3.0:1787848242.977853:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787848242.977861:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f919850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+7:5836:x1874694631339776:12345-0@lo:104: 00010000:00010000:3.0:1787848242.977881:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.977964:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787848242.977969:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f919850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+7:5836:x1874694631339776:12345-0@lo:104: Request processed in 110us (2772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848242.977977:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787848242.978022:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787848242.978029:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+6:5836:x1874694631339904:12345-0@lo:104: 00010000:00010000:3.0:1787848242.978036:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978075:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787848242.978080:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+6:5836:x1874694631339904:12345-0@lo:104: Request processed in 53us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848242.978087:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787848242.978100:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787848242.978105:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:5836:x1874694631340160:12345-0@lo:104: 00010000:00010000:3.0:1787848242.978112:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978135:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787848242.978139:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:5836:x1874694631340160:12345-0@lo:104: Request processed in 35us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848242.978145:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787848242.978156:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787848242.978161:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+4:5836:x1874694631340288:12345-0@lo:104: 00010000:00010000:3.0:1787848242.978168:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978202:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787848242.978207:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+4:5836:x1874694631340288:12345-0@lo:104: Request processed in 47us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848242.978213:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787848242.978231:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787848242.978237:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978244:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c6000 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848242.978248:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978256:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848242.978263:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848242.978269:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787848242.978317:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978323:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848242.978341:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978348:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff444c6000/0x9aeb41e0543cb3b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb3bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978370:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787848242.978373:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978379:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5e00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848242.978382:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978389:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848242.978395:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848242.978399:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787848242.978413:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978418:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848242.978423:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978430:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb38a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978440:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787848242.978443:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978457:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff413a0800 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848242.978460:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978466:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848242.978473:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848242.978478:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787848242.978492:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978498:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848242.978512:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978518:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff413a0800/0x9aeb41e0543cb344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb34b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978528:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848242.978531:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978537:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030e00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848242.978539:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978554:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848242.978560:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848242.978564:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787848242.978577:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978592:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848242.978598:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978605:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cb31a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb321 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.978614:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848242.978615:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848242.978617:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848242.978657:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631340416:0@lo:103: 00000100:00100000:3.0:1787848242.978817:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848242.978857:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787848242.978864:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631340544:0@lo:103: 00000100:00100000:3.0:1787848242.978885:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848242.978911:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631340672:0@lo:103: 00000100:00100000:3.0:1787848242.978931:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848242.978946:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848242.978958:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631340800:0@lo:103: 00000100:00100000:3.0:1787848242.978998:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848242.979025:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631340416 00000100:00100000:3.0:1787848242.979030:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631340416 00010000:00010000:3.0:1787848242.979051:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cb3bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb3b4 expref: 17 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848242.979067:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631340544 00000100:00100000:3.0:1787848242.979070:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631340544 00010000:00010000:3.0:1787848242.979079:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff414a5c00/0x9aeb41e0543cb391 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb38a expref: 18 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848242.979089:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631340672 00000100:00100000:3.0:1787848242.979091:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631340672 00010000:00010000:3.0:1787848242.979099:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff40030000/0x9aeb41e0543cb34b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb344 expref: 19 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848242.979106:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631340800 00000100:00100000:3.0:1787848242.979108:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631340800 00010000:00010000:3.0:1787848242.979116:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb31a expref: 20 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848242.979127:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787848242.979133:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+20:3310:x1874694631340416:12345-0@lo:103: 00010000:00010000:3.0:1787848242.979145:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848242.979150:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cb3bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb3b4 expref: 20 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.979161:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cb3bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb3b4 expref: 20 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.979180:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848242.979214:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+20:3310:x1874694631340416:12345-0@lo:103: Request processed in 81us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848242.979221:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787848242.979236:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787848242.979242:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631340544:12345-0@lo:103: 00010000:00010000:3.0:1787848242.979249:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848242.979254:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff414a5c00/0x9aeb41e0543cb391 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb38a expref: 19 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.979263:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff414a5c00/0x9aeb41e0543cb391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb38a expref: 19 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.979283:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848242.979306:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631340544:12345-0@lo:103: Request processed in 64us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848242.979312:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787848242.979324:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787848242.979330:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:3312:x1874694631340672:12345-0@lo:103: 00010000:00010000:3.0:1787848242.979337:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848242.979342:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff40030000/0x9aeb41e0543cb34b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb344 expref: 18 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.979349:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff40030000/0x9aeb41e0543cb34b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb344 expref: 18 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.979357:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848242.979381:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:3312:x1874694631340672:12345-0@lo:103: Request processed in 51us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848242.979387:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787848242.979405:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787848242.979411:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:3312:x1874694631340800:12345-0@lo:103: 00010000:00010000:3.0:1787848242.979418:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848242.979422:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb31a expref: 17 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.979430:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb31a expref: 17 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.979440:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848242.979461:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:3312:x1874694631340800:12345-0@lo:103: Request processed in 50us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848242.979466:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787848242.979502:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631340544:0@lo:103: 00000100:00100000:3.0:1787848242.979511:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631340416:0@lo:103: 00000100:00100000:3.0:1787848242.979535:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631340800:0@lo:103: 00000100:00100000:3.0:1787848242.979541:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631340672:0@lo:103: 00000100:00100000:1.0:1787848242.979946:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787848242.979955:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5836:x1874694631340032:12345-0@lo:104: 00010000:00010000:1.0:1787848242.979965:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848242.980004:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787848242.980009:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5836:x1874694631340032:12345-0@lo:104: Request processed in 56us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848242.980015:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787848242.980141:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cb3bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb3b4 expref: 16 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848242.980153:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874694631339776:0@lo:104: 00010000:00010000:2.0:1787848242.980172:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff414a5c00/0x9aeb41e0543cb391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb38a expref: 15 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848242.980182:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874694631339904:0@lo:104: 00000100:00100000:2.0:1787848242.980189:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874694631340032:0@lo:104: 00010000:00010000:2.0:1787848242.980197:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40030000/0x9aeb41e0543cb34b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb344 expref: 14 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848242.980204:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874694631340160:0@lo:104: 00010000:00010000:2.0:1787848242.980213:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb31a expref: 13 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848242.980220:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874694631340288:0@lo:104: 00010000:00010000:2.0:1787848242.980246:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980321:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848242.980326:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980335:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5600 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848242.980338:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980346:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848242.980364:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848242.980369:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787848242.980401:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980408:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848242.980421:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980428:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb36e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb375 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980442:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848242.980443:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848242.980445:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848242.980454:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631340928:0@lo:103: 00000100:00100000:3.0:1787848242.980482:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848242.980517:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631340928 00000100:00100000:3.0:1787848242.980522:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631340928 00010000:00010000:3.0:1787848242.980536:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb36e expref: 13 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848242.980566:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787848242.980573:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:3310:x1874694631340928:12345-0@lo:103: 00010000:00010000:3.0:1787848242.980581:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848242.980696:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848242.980827:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb36e expref: 13 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980845:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb36e expref: 13 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980857:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb36e expref: 13 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980868:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980877:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980890:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980897:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980903:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980909:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980915:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff413a1400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848242.980919:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980926:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980956:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848242.980965:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848242.980994:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:3310:x1874694631340928:12345-0@lo:103: Request processed in 421us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848242.981001:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787848242.981028:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631340928:0@lo:103: 00010000:00010000:0.0:1787848242.981107:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848242.981115:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848242.981121:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff413a1400/0x9aeb41e0543cb3d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787848242.981133:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787848243.098032:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:7642:x1874694631339648:12345-0@lo:253: Request processed in 155480us (155898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848243.098049:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787848243.098173:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631339648:0@lo:253: 10000000:01000000:0.0:1787848243.098190:0:7642:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787848243.098193:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787848243.098195:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787848243.098196:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787848243.098198:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787848243.098199:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787848243.098200:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787848243.098202:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787848243.098204:0:7642:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787848243.098206:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787848243.098207:0:7642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787848243.098230:0:7642:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93fe41342800 from lustre-OST0001 10000000:01000000:0.0:1787848243.098256:0:7642:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787848243.098260:0:7642:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787848243.098296:0:7642:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93ff520ab3a0 local copy 10000000:01000000:0.0:1787848243.098301:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787848243.098342:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848243.098353:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848243.098363:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848243.098384:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341056:0@lo:101: 00000100:00100000:0.0:1787848243.098426:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848243.098485:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fa999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848243.098548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631341056 00000100:00100000:1.0:1787848243.098556:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631341056 00000100:00100000:1.0:1787848243.098769:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787848243.098778:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+11:7642:x1874694631341056:12345-0@lo:101: 00010000:00010000:1.0:1787848243.098791:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848243.098877:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb3de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb3d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.098907:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb3d7 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.098917:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb3d7 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.098927:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff414a4600, rc 0) 00000100:00100000:1.0:1787848243.099068:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341056:12345-0@lo:101: Request processed in 290us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848243.099075:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787848243.099347:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341056:0@lo:101: 00010000:00010000:2.0:1787848243.099363:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.099372:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848243.099480:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341184:0@lo:501: 00000100:00100000:2.0:1787848243.099524:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848243.099924:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813ac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848243.099973:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631341184 00000100:00100000:1.0:1787848243.099980:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631341184 00000100:00100000:0.0:1787848243.100122:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787848243.100131:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341184:12345-0@lo:501: 00000100:00100000:0.0:1787848243.100389:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341184:12345-0@lo:501: Request processed in 259us (864us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787848243.100397:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787848243.100478:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341184:0@lo:501: 10000000:01000000:1.0:1787848243.100498:0:7642:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787848243.100530:0:7642:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787848243.100537:0:7642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.100546:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.100565:0:7642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.100594:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787848243.100619:0:7642:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93fe41342800 10000000:01000000:1.0:1787848243.100624:0:7642:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787848243.100631:0:7642:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787848243.100634:0:7642:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787848243.100659:0:7642:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787848243.100663:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787848243.100698:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.100706:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.100713:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848243.100726:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341312:0@lo:101: 00000100:00100000:1.0:1787848243.100755:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787848243.100794:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848243.100974:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.100982:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030600 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:2.0:1787848243.100985:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.100993:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787848243.100999:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848243.101004:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787848243.101024:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.101029:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787848243.101048:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.101054:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff40030600/0x9aeb41e0543cb3d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aeb41e0543cb3de expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.101067:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848243.101069:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848243.101070:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848243.101205:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787848243.103262:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631341312 00000100:00100000:3.0:1787848243.103284:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631341312 00000100:00100000:3.0:1787848243.103343:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787848243.103353:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341312:12345-0@lo:101: 00010000:00010000:3.0:1787848243.103369:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848243.103388:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb3ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb3e5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848243.103416:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb3e5 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848243.103427:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb3e5 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848243.103437:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c6000, rc 0) 00000100:00100000:3.0:1787848243.103792:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:7642:x1874694631341312:12345-0@lo:101: Request processed in 439us (3034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848243.103810:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787848243.103883:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631341440:0@lo:103: 00000100:00100000:3.0:1787848243.103926:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848243.103984:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631341440 00000100:00100000:3.0:1787848243.103989:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631341440 00000100:00100000:3.0:1787848243.104017:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787848243.104024:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:3311:x1874694631341440:12345-0@lo:103: 00010000:00010000:3.0:1787848243.104034:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848243.104049:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb3de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb3d7 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848243.104063:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848243.104090:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:3311:x1874694631341440:12345-0@lo:103: Request processed in 66us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848243.104096:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787848243.104129:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631341440:0@lo:103: 00000100:00100000:1.0:1787848243.104307:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341312:0@lo:101: 00010000:00010000:1.0:1787848243.104323:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.104332:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848243.104459:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341568:0@lo:501: 00000100:00100000:1.0:1787848243.104488:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848243.104520:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787848243.104600:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631341568 00000100:00100000:0.0:1787848243.104605:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631341568 00000100:00100000:0.0:1787848243.104633:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787848243.104658:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341568:12345-0@lo:501: 00000100:00100000:0.0:1787848243.104935:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341568:12345-0@lo:501: Request processed in 294us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848243.104943:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787848243.105251:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341568:0@lo:501: 00000100:00100000:1.0:1787848243.105296:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341696:0@lo:503: 00000100:00100000:1.0:1787848243.105337:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848243.109987:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787848243.110724:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631341696 00000100:00100000:0.0:1787848243.110735:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631341696 00000100:00100000:0.0:1787848243.110793:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787848243.110836:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341696:12345-0@lo:503: 00000100:00100000:0.0:1787848243.111099:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341696:12345-0@lo:503: Request processed in 267us (5759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848243.111107:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787848243.111931:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341696:0@lo:503: 00000040:00080000:1.0:1787848243.117098:0:7642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787848243.117194:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341824:0@lo:502: 00000100:00100000:1.0:1787848243.117285:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848243.117329:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787848243.118217:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631341824 00000100:00100000:0.0:1787848243.118225:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631341824 00000100:00100000:0.0:1787848243.118294:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787848243.118304:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341824:12345-0@lo:502: 00000100:00100000:0.0:1787848243.118566:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341824:12345-0@lo:502: Request processed in 263us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848243.118575:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787848243.118982:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341824:0@lo:502: 00000040:00080000:1.0:1787848243.119306:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787848243.119374:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787848243.119405:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787848243.119448:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787848243.119479:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787848243.119509:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787848243.119544:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341952:0@lo:502: 00000100:00100000:1.0:1787848243.121989:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848243.125583:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787848243.127873:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631341952 00000100:00100000:3.0:1787848243.127889:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631341952 00000100:00100000:3.0:1787848243.127968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787848243.127979:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341952:12345-0@lo:502: 00000100:00100000:3.0:1787848243.128349:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631341952:12345-0@lo:502: Request processed in 371us (6367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848243.128358:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787848243.129093:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631341952:0@lo:502: 00000040:00080000:2.0:1787848243.129297:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787848243.129315:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787848243.130630:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787848243.130943:0:7649:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787848243.130952:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848243.130955:0:7649:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787848243.130963:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787848243.130990:0:7649:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93ff79398000) 00000020:00000080:0.0:1787848243.131014:0:7649:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787848243.131034:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787848243.131097:0:7649:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93fe41342800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787848243.131105:0:7649:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787848243.131111:0:7649:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aeb41e0543cb3fa 00010000:00010000:0.0:1787848243.139194:0:7649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787848243.140104:0:7649:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787848243.144296:0:7649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787848243.144578:0:7649:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787848243.152402:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787848243.153442:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787848243.158231:0:7649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787848243.158243:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848243.158250:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848243.158253:0:7649:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787848243.158257:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787848243.158261:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848243.158322:0:7649:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787848243.158330:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787848243.158332:0:7649:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787848243.158394:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848243.158398:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848243.158399:0:7649:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787848243.158403:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787848243.165170:0:7642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787848243.165215:0:7642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787848243.165243:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.165257:0:7642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848243.165298:0:7642:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93fe41342800 from 1 10000000:01000000:3.0:1787848243.165303:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787848243.165353:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848243.165362:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848243.165373:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848243.165400:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342080:0@lo:101: 00000100:00100000:3.0:1787848243.165473:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848243.165520:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff460eb900 going to sleep for 11 seconds 00000100:00100000:1.0:1787848243.165788:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631342080 00000100:00100000:1.0:1787848243.165806:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631342080 00000100:00100000:1.0:1787848243.165870:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787848243.165878:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:7642:x1874694631342080:12345-0@lo:101: 00010000:00010000:1.0:1787848243.165893:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848243.165905:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff414a5e00/0x9aeb41e0543cb408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb401 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.165944:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff414a5e00/0x9aeb41e0543cb408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb401 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.165955:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff414a5e00/0x9aeb41e0543cb408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb401 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.165963:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff414a5e00, rc 0) 00000100:00100000:1.0:1787848243.166017:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:7642:x1874694631342080:12345-0@lo:101: Request processed in 140us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848243.166025:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787848243.166073:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342080:0@lo:101: 00010000:00010000:2.0:1787848243.166088:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.166097:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848243.166205:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342208:0@lo:501: 00000100:00100000:2.0:1787848243.166233:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848243.166265:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813acc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787848243.167149:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631342208 00000100:00100000:3.0:1787848243.167155:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631342208 00000100:00100000:3.0:1787848243.167201:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787848243.167209:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:7642:x1874694631342208:12345-0@lo:501: 00000100:00100000:3.0:1787848243.167572:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:7642:x1874694631342208:12345-0@lo:501: Request processed in 362us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848243.167581:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787848243.171942:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342208:0@lo:501: 00000100:00100000:3.0:1787848243.176102:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342336:0@lo:503: 00000100:00100000:3.0:1787848243.176202:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848243.176295:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff460eb300 going to sleep for 11 seconds 00000100:00100000:0.0:1787848243.177868:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631342336 00000100:00100000:0.0:1787848243.177881:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631342336 00000100:00100000:0.0:1787848243.177932:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787848243.177942:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:7642:x1874694631342336:12345-0@lo:503: 00000100:00100000:0.0:1787848243.178393:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:7642:x1874694631342336:12345-0@lo:503: Request processed in 451us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848243.178402:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787848243.178573:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342336:0@lo:503: 00000040:00080000:3.0:1787848243.178920:0:7642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787848243.178988:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342464:0@lo:502: 00000100:00100000:3.0:1787848243.179035:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848243.179070:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff460eb300 going to sleep for 11 seconds 00000100:00100000:0.0:1787848243.179377:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631342464 00000100:00100000:0.0:1787848243.179383:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631342464 00000100:00100000:0.0:1787848243.179422:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787848243.179430:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:7642:x1874694631342464:12345-0@lo:502: 00000100:00100000:0.0:1787848243.180010:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:7642:x1874694631342464:12345-0@lo:502: Request processed in 578us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848243.180019:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787848243.180183:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342464:0@lo:502: 00000040:00080000:1.0:1787848243.180490:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787848243.180542:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787848243.180574:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342592:0@lo:502: 00000100:00100000:1.0:1787848243.180923:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848243.180961:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787848243.181015:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631342592 00000100:00100000:0.0:1787848243.181021:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631342592 00000100:00100000:0.0:1787848243.181059:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787848243.181066:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:7642:x1874694631342592:12345-0@lo:502: 00000100:00100000:0.0:1787848243.181248:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:7642:x1874694631342592:12345-0@lo:502: Request processed in 181us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848243.181256:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787848243.181371:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342592:0@lo:502: 00000040:00080000:1.0:1787848243.181469:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787848243.181480:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787848243.182327:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787848243.182340:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848243.182343:0:7653:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787848243.182350:0:7653:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93fe41342800 00000020:00000080:2.0:1787848243.182353:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787848243.182373:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848243.182376:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848243.182387:0:7653:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787848243.182390:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787848243.182532:0:7642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787848243.182568:0:7642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787848243.182598:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.182618:0:7642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848243.182996:0:7642:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787848243.183000:0:7642:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93fe41342800 10000000:01000000:1.0:1787848243.183004:0:7642:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93fe41342800 10000000:01000000:1.0:1787848243.183008:0:7642:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787848243.183014:0:7642:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93fe41342800 from 1 10000000:01000000:1.0:1787848243.183017:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787848243.183054:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.183062:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.183073:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848243.183093:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342720:0@lo:101: 00000100:00100000:1.0:1787848243.183153:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848243.183195:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787848243.183247:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631342720 00000100:00100000:0.0:1787848243.183253:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631342720 00000100:00100000:0.0:1787848243.183308:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787848243.183317:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:7642:x1874694631342720:12345-0@lo:101: 00010000:00010000:0.0:1787848243.183330:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848243.183343:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb40f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848243.183369:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb40f expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848243.183393:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb40f expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848243.183403:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030e00, rc 0) 00000100:00100000:0.0:1787848243.183457:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7642:x1874694631342720:12345-0@lo:101: Request processed in 141us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848243.183464:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787848243.183547:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342720:0@lo:101: 00010000:00010000:2.0:1787848243.183562:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.183571:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848243.183784:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342848:0@lo:501: 00000100:00100000:2.0:1787848243.183880:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848243.183896:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813ac900 going to sleep for 11 seconds 00000100:00100000:3.0:1787848243.183963:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631342848 00000100:00100000:3.0:1787848243.183968:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631342848 00000100:00100000:3.0:1787848243.184002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787848243.184010:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7642:x1874694631342848:12345-0@lo:501: 00000100:00100000:3.0:1787848243.184248:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7642:x1874694631342848:12345-0@lo:501: Request processed in 238us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848243.184255:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787848243.184392:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342848:0@lo:501: 00000100:00100000:2.0:1787848243.184423:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342976:0@lo:503: 00000100:00100000:2.0:1787848243.184460:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848243.184485:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813ac900 going to sleep for 11 seconds 00000100:00100000:2.0:1787848243.184501:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631342976 00000100:00100000:2.0:1787848243.184505:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631342976 00000100:00100000:2.0:1787848243.184524:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787848243.184529:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7642:x1874694631342976:12345-0@lo:503: 00010000:00010000:0.0:1787848243.184853:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848243.184972:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7642:x1874694631342976:12345-0@lo:503: Request processed in 440us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848243.184979:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787848243.185301:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631342976:0@lo:503: 00000040:00080000:0.0:1787848243.185945:0:7642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787848243.186018:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631343104:0@lo:502: 00000100:00100000:0.0:1787848243.186075:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848243.186112:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fa999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848243.186192:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631343104 00000100:00100000:2.0:1787848243.186197:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631343104 00000100:00100000:2.0:1787848243.186235:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787848243.186242:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7642:x1874694631343104:12345-0@lo:502: 00000100:00100000:2.0:1787848243.186468:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7642:x1874694631343104:12345-0@lo:502: Request processed in 226us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848243.186475:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787848243.186921:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631343104:0@lo:502: 00000040:00080000:0.0:1787848243.187216:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787848243.187295:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787848243.187333:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787848243.187396:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787848243.187439:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787848243.187489:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787848243.187528:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787848243.187560:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787848243.190025:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787848243.190101:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787848243.190139:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787848243.190214:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787848243.190256:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787848243.190307:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787848243.190374:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787848243.190414:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787848243.190451:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787848243.190522:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787848243.190560:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787848243.190595:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787848243.191893:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787848243.191994:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787848243.192031:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787848243.192093:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787848243.192129:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787848243.192161:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787848243.192205:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787848243.192240:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787848243.192304:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787848243.192379:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787848243.192421:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787848243.192458:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787848243.192493:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787848243.192575:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787848243.197355:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787848243.197446:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787848243.197487:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787848243.197543:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631343232:0@lo:502: 00000100:00100000:0.0:1787848243.197689:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848243.197734:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fa999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848243.197990:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631343232 00000100:00100000:3.0:1787848243.197997:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631343232 00000100:00100000:3.0:1787848243.198055:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787848243.198065:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7642:x1874694631343232:12345-0@lo:502: 00000100:00100000:3.0:1787848243.198323:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7642:x1874694631343232:12345-0@lo:502: Request processed in 258us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848243.198330:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787848243.198446:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631343232:0@lo:502: 00000040:00080000:0.0:1787848243.198537:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787848243.198548:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787848243.202412:0:7654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787848243.202431:0:7654:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93ff510319d0) 00000020:00000080:1.0:1787848243.202455:0:7654:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1787848243.202543:0:7654:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93fe41342800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787848243.202547:0:7654:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93fe41342800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787848243.202550:0:7654:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93fe41342800 3 00010000:00080000:1.0:1787848243.202590:0:7654:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ff5f530800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.126@tcp at head 00010000:00010000:1.0:1787848243.204191:0:7654:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787848243.204397:0:7654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787848243.204428:0:7654:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787848243.204439:0:7654:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9aeb41e0543cb424 00000100:00080000:1.0:1787848243.204448:0:7654:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787848243.204454:0:7654:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93ff5f530800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:1.0:1787848243.204485:0:7654:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff55ae52c0 x1874694631343360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787848243.204501:0:7654:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787848243.206925:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874694631343360:0@lo:38: 00000100:00100000:3.0:1787848243.207010:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848243.207085:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631343488:0@lo:400: 00000100:00100000:3.0:1787848243.207111:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848243.207136:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848243.207143:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff8074bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631343616:0@lo:400: 00000100:00100000:3.0:1787848243.207167:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848243.207209:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff8074b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631343744:0@lo:400: 00000100:00100000:3.0:1787848243.207236:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848243.207280:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631343360 00000100:00100000:3.0:1787848243.207288:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631343360 00000100:00100000:3.0:1787848243.207322:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631343488 00000100:00100000:3.0:1787848243.207325:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631343488 00000100:00100000:3.0:1787848243.207348:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631343616 00000100:00100000:3.0:1787848243.207350:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631343616 00000100:00100000:3.0:1787848243.207377:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787848243.207386:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631343488:12345-0@lo:400: 00000100:00100000:3.0:1787848243.207440:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631343488:12345-0@lo:400: Request processed in 55us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848243.207447:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787848243.207464:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787848243.207470:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631343616:12345-0@lo:400: 00000100:00100000:3.0:1787848243.207497:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631343616:12345-0@lo:400: Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848243.207503:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787848243.207515:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848243.207518:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874694631343360:12345-0@lo:38: 00010000:00080000:3.0:1787848243.207541:0:5843:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:3.0:1787848243.207577:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9aeb41e0543cb42b 00000004:00100000:3.0:1787848243.207604:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787848243.207636:0:5843:0:(import.c:65:import_set_state_nolock()) ffff93ff4ed09000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787848243.207713:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874694631343360:12345-0@lo:38: Request processed in 192us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848243.207719:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848243.207752:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631343744 00000100:00100000:3.0:1787848243.207756:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631343744 00000100:00100000:3.0:1787848243.207788:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848243.207911:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631343744:12345-0@lo:400: 00000100:00100000:3.0:1787848243.207952:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631343744:12345-0@lo:400: Request processed in 158us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848243.207960:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787848243.207982:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848243.207986:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787848243.208015:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff8074b480 x1874694631343744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848243.208029:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff8074b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631343744:0@lo:400: 00010000:00080000:3.0:1787848243.208059:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff8074bc00 x1874694631343616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848243.208070:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff8074bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631343616:0@lo:400: 00010000:00080000:3.0:1787848243.208079:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff55ae6d00 x1874694631343488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848243.208087:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631343488:0@lo:400: 00010000:00080000:3.0:1787848243.208117:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff55ae52c0 x1874694631343360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787848253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848243.208126:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787848243.208133:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787848243.208140:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787848243.208146:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787848243.208148:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff5f530800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787848243.208154:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874694631343360:0@lo:38: 00000040:00080000:1.0:1787848243.212073:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1787848243.212698:0:7642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787848243.212736:0:7642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787848243.212765:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848243.212778:0:7642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787848243.213010:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787848243.213012:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787848243.213014:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787848243.213015:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787848243.213016:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787848243.213017:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787848243.213019:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787848243.213020:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787848243.213022:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787848243.213024:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787848243.213025:0:7642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787848243.213030:0:7642:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787848243.213032:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787848243.213033:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787848243.213035:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787848243.213036:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787848243.213037:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787848243.213038:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787848243.213039:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787848243.213040:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787848243.213041:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787848243.213042:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787848243.213043:0:7642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787848243.213072:0:7642:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787848243.213094:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631343872:0@lo:253: 00000100:00100000:0.0:1787848243.213189:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848243.213229:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fa999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848243.213364:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae52c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7656:1874694631344000:0@lo:901: 00000100:00100000:3.0:1787848243.213400:0:7656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848243.213430:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff460eb900 going to sleep for 11 seconds 00000100:00100000:1.0:1787848243.213922:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631343872 00000100:00100000:1.0:1787848243.213929:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631343872 00000100:00100000:1.0:1787848243.214024:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787848243.214034:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7642:x1874694631343872:12345-0@lo:253: 20000000:01000000:1.0:1787848243.214060:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787848243.214074:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787848243.215840:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631344000 00000100:00100000:0.0:1787848243.215851:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631344000 00000100:00100000:0.0:1787848243.215926:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848243.215948:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7656:x1874694631344000:12345-0@lo:901: 00000100:00100000:0.0:1787848243.216344:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7656:x1874694631344000:12345-0@lo:901: Request processed in 396us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848243.216354:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787848243.217693:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787848243.221190:0:7656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff55ae52c0 x1874694631344000/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787848259 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848243.221210:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae52c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7656:1874694631344000:0@lo:901: 20000000:01000000:1.0:1787848243.264228:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787848243.264242:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787848243.266517:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787848243.266526:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787848243.266548:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848243.266569:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb37c expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848243.266762:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848243.266806:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb37c expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848243.266821:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb37c expref: 14 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848243.266839:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae52c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874694631344128:0@lo:104: 00000100:00100000:3.0:1787848243.266909:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848243.267094:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe410b0240 going to sleep for 11 seconds 00000100:00100000:0.0:1787848243.267329:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631344128 00000100:00100000:0.0:1787848243.267338:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631344128 00000100:00100000:0.0:1787848243.267499:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787848243.267509:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5858:x1874694631344128:12345-0@lo:104: 00010000:00010000:0.0:1787848243.267524:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848243.267598:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787848243.267605:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:5858:x1874694631344128:12345-0@lo:104: Request processed in 97us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848243.267612:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787848243.267839:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae52c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874694631344128:0@lo:104: 00010000:00010000:2.0:1787848243.267861:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.267879:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848243.267885:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.267891:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a4400 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:2.0:1787848243.267895:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.267902:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787848243.267908:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848243.267914:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787848243.267942:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.267969:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787848243.267986:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.267992:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a4400/0x9aeb41e0543cb37c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848243.268009:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848243.268011:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848243.268012:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848243.270624:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7642:x1874694631343872:12345-0@lo:253: Request processed in 56579us (57422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848243.270667:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787848243.270902:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7642:1874694631343872:0@lo:253: 10000000:01000000:2.0:1787848243.270918:0:7642:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787848243.270921:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787848243.270922:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787848243.270923:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848243.270925:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848243.270925:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848243.270926:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848243.270928:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848243.270929:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787848243.270930:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787848243.270932:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848243.270933:0:7642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787848243.270955:0:7642:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787848243.273325:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631344256:0@lo:103: 00000100:00100000:3.0:1787848243.273425:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848243.277381:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631344256 00000100:00100000:1.0:1787848243.277401:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631344256 00010000:00010000:1.0:1787848243.277455:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb37c expref: 14 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848243.277668:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787848243.277756:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff50bb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:3311:x1874694631344256:12345-0@lo:103: 00010000:00010000:1.0:1787848243.277773:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848243.277780:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb37c expref: 14 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.277810:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb37c expref: 14 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.277830:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb37c expref: 14 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.277849:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.277858:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787848243.277875:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013969231s 00010000:00010000:1.0:1787848243.277879:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.277887:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.277893:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.277899:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.277905:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c7600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848243.277909:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.277917:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.277957:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848243.277969:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848243.278061:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff50bb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:3311:x1874694631344256:12345-0@lo:103: Request processed in 311us (4634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848243.278069:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787848243.278168:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848243.278178:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848243.278184:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb432 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1787848243.279346:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848243.279575:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787848243.279800:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848243.279986:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787848243.280173:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848243.280444:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000100:00100000:3.0:1787848243.280885:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631344256:0@lo:103: 00000001:00000004:2.0:1787848243.283088:0:7642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787848243.500893:0:7642:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787848243.500902:0:7642:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787848243.500942:0:7642:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787848243.501030:0:7642:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787848243.501044:0:7642:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787848243.501082:0:7642:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787848244.208777:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848245.104398:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631344384:0@lo:13: 00000100:00100000:0.0:1787848245.104511:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848245.105439:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631344384 00000100:00100000:2.0:1787848245.105451:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631344384 00000100:00100000:2.0:1787848245.105527:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787848245.105536:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631344384:12345-0@lo:13: 00002000:00000024:2.0:1787848245.105575:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848245.105655:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631344384:12345-0@lo:13: Request processed in 121us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848245.105664:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787848245.105719:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787848245.106336:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff55bdcb40 x1874694631344384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848245.106361:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631344384:0@lo:13: 00010000:00010000:2.0:1787848245.232513:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848246.255943:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848247.279769:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848248.304803:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848248.691560:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631344896:0@lo:400: 00000100:00100000:3.0:1787848248.691663:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848248.691730:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787848248.691737:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631344512:0@lo:400: 00000100:00100000:3.0:1787848248.691766:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848248.691805:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631345024:0@lo:400: 00000100:00100000:3.0:1787848248.691830:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848248.691860:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631344640:0@lo:400: 00000100:00100000:3.0:1787848248.691883:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848248.691902:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787848248.691908:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631344768:0@lo:400: 00000100:00100000:3.0:1787848248.691929:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848248.691995:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631344896 00000100:00100000:3.0:1787848248.692003:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631344896 00000100:00100000:3.0:1787848248.692057:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787848248.692066:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631344896:12345-0@lo:400: 00000100:00100000:3.0:1787848248.692120:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631344896:12345-0@lo:400: Request processed in 55us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848248.692127:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787848248.692150:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631345024 00000100:00100000:3.0:1787848248.692153:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631345024 00000100:00100000:3.0:1787848248.692189:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631344640 00000100:00100000:3.0:1787848248.692192:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631344640 00000100:00100000:3.0:1787848248.692203:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631344768 00000100:00100000:3.0:1787848248.692205:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631344768 00000100:00100000:3.0:1787848248.692230:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787848248.692235:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631345024:12345-0@lo:400: 00000100:00100000:3.0:1787848248.692265:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631345024:12345-0@lo:400: Request processed in 30us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848248.692270:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787848248.692281:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787848248.692287:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631344640:12345-0@lo:400: 00000100:00100000:3.0:1787848248.692316:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631344640:12345-0@lo:400: Request processed in 30us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848248.692321:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787848248.692333:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787848248.692339:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631344768:12345-0@lo:400: 00000100:00100000:3.0:1787848248.692363:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631344768:12345-0@lo:400: Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848248.692369:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787848248.692391:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787848248.692395:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787848248.692440:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d08f00 x1874694631344768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848248.692455:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631344768:0@lo:400: 00010000:00080000:3.0:1787848248.692467:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0b0c0 x1874694631344640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848248.692475:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631344640:0@lo:400: 00010000:00080000:3.0:1787848248.692507:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0ad00 x1874694631345024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848248.692528:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631345024:0@lo:400: 00010000:00080000:3.0:1787848248.692545:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0a1c0 x1874694631344896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848248.692553:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631344896:0@lo:400: 00000100:00100000:2.0:1787848248.693101:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631344512 00000100:00100000:2.0:1787848248.693108:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631344512 00000100:00100000:2.0:1787848248.693149:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787848248.693157:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:3312:x1874694631344512:12345-0@lo:400: 00000100:00100000:2.0:1787848248.693221:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:3312:x1874694631344512:12345-0@lo:400: Request processed in 66us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848248.693228:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787848248.698115:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631344512:0@lo:400: 00010000:00010000:1.0:1787848249.329651:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787848249.713930:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787848249.713942:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ff4314e000 from 30 10000000:01000000:0.0:1787848249.713948:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787848249.714010:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848249.714023:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848249.714035:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848249.714542:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631345152:0@lo:101: 00000100:00100000:0.0:1787848249.714627:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848249.714714:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff48435600 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.714985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631345152 00000100:00100000:2.0:1787848249.714994:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631345152 00000100:00100000:2.0:1787848249.715123:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787848249.715134:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631345152:12345-0@lo:101: 00010000:00010000:2.0:1787848249.715149:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848249.715179:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff413a1a00/0x9aeb41e0543cb440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb439 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.715207:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff413a1a00/0x9aeb41e0543cb440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb439 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.715229:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff413a1a00/0x9aeb41e0543cb440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb439 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.715238:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff413a1a00, rc 0) 00000100:00100000:2.0:1787848249.715285:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631345152:12345-0@lo:101: Request processed in 153us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.715291:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787848249.716714:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631345152:0@lo:101: 00010000:00010000:0.0:1787848249.716741:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848249.716765:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848249.716842:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631345280:0@lo:501: 00000100:00100000:0.0:1787848249.716890:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848249.716935:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff48435600 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.717075:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631345280 00000100:00100000:2.0:1787848249.717081:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631345280 00000100:00100000:2.0:1787848249.717128:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787848249.717138:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631345280:12345-0@lo:501: 00000100:00100000:2.0:1787848249.717922:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631345280:12345-0@lo:501: Request processed in 784us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.717932:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787848249.718077:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631345280:0@lo:501: 00000100:00100000:0.0:1787848249.718115:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631345408:0@lo:503: 00000100:00100000:0.0:1787848249.718171:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848249.718211:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff48435600 going to sleep for 11 seconds 00000100:00100000:0.0:1787848249.718228:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631345408 00000100:00100000:0.0:1787848249.718233:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631345408 00000100:00100000:0.0:1787848249.718273:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787848249.718280:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631345408:12345-0@lo:503: 00000100:00100000:0.0:1787848249.720606:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631345408:12345-0@lo:503: Request processed in 2314us (2423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848249.720625:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787848249.720739:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631345408:0@lo:503: 00000100:00100000:1.0:1787848249.730258:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80749680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7930:1874694631345536:0@lo:502: 00000100:00100000:1.0:1787848249.730349:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848249.730445:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe410b0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787848249.739884:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631345536 00000100:00100000:0.0:1787848249.739900:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631345536 00000100:00100000:0.0:1787848249.741298:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787848249.741321:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7930:x1874694631345536:12345-0@lo:502: 00000100:00100000:0.0:1787848249.741975:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7930:x1874694631345536:12345-0@lo:502: Request processed in 663us (11625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848249.741985:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787848249.742677:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80749680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7930:1874694631345536:0@lo:502: 00000100:00100000:1.0:1787848249.742765:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80749680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7930:1874694631345664:0@lo:502: 00000100:00100000:1.0:1787848249.742817:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848249.747171:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe410b0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.750648:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631345664 00000100:00100000:2.0:1787848249.750663:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631345664 00000100:00100000:2.0:1787848249.750723:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787848249.750733:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7930:x1874694631345664:12345-0@lo:502: 00000100:00100000:2.0:1787848249.751047:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:7930:x1874694631345664:12345-0@lo:502: Request processed in 315us (8229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.751056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787848249.752323:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80749680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7930:1874694631345664:0@lo:502: 00000040:00080000:1.0:1787848249.752374:0:7930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787848249.756200:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787848249.756238:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787848249.756249:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.756263:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848249.756285:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787848249.756287:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787848249.756290:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787848249.756326:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.756334:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.756346:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848249.756371:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631345792:0@lo:101: 00000100:00100000:2.0:1787848249.756444:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.756503:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe410b2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.756533:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631345792 00000100:00100000:2.0:1787848249.756539:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631345792 00000100:00100000:2.0:1787848249.756582:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787848249.756591:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631345792:12345-0@lo:101: 00010000:00010000:2.0:1787848249.756604:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848249.756617:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff413a0800/0x9aeb41e0543cb44e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb447 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.756657:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff413a0800/0x9aeb41e0543cb44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb447 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.756669:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff413a0800/0x9aeb41e0543cb44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb447 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.756689:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff413a0800, rc 0) 00000100:00100000:2.0:1787848249.756725:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631345792:12345-0@lo:101: Request processed in 135us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.756733:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787848249.756780:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631345792:0@lo:101: 00010000:00010000:2.0:1787848249.756795:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.756803:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848249.756851:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631345920:0@lo:501: 00000100:00100000:2.0:1787848249.756876:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.756889:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff430dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.756901:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631345920 00000100:00100000:2.0:1787848249.756904:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631345920 00000100:00100000:2.0:1787848249.756920:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787848249.756926:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631345920:12345-0@lo:501: 00000100:00100000:2.0:1787848249.757203:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631345920:12345-0@lo:501: Request processed in 276us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.757210:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787848249.757238:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631345920:0@lo:501: 00000100:00100000:2.0:1787848249.757265:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631346048:0@lo:503: 00000100:00100000:2.0:1787848249.757304:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.757318:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff430dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.757334:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631346048 00000100:00100000:2.0:1787848249.757338:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631346048 00000100:00100000:2.0:1787848249.757353:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787848249.757359:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631346048:12345-0@lo:503: 00000100:00100000:2.0:1787848249.757628:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631346048:12345-0@lo:503: Request processed in 268us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.757636:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787848249.757700:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631346048:0@lo:503: 00000100:00100000:2.0:1787848249.757892:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7933:1874694631346176:0@lo:502: 00000100:00100000:2.0:1787848249.757927:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.757945:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631346176 00000100:00100000:2.0:1787848249.757949:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631346176 00000100:00100000:2.0:1787848249.757968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787848249.757974:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:7933:x1874694631346176:12345-0@lo:502: 00000100:00100000:2.0:1787848249.758145:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:7933:x1874694631346176:12345-0@lo:502: Request processed in 170us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.758152:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787848249.758190:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff430dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.758202:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7933:1874694631346176:0@lo:502: 00000020:01000000:2.0:1787848249.758222:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787848249.758232:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848249.758234:0:7933:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787848249.758240:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787848249.758242:0:7933:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787848249.758256:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7933:1874694631346304:0@lo:502: 00000100:00100000:2.0:1787848249.758288:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.758307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631346304 00000100:00100000:2.0:1787848249.758316:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631346304 00000100:00100000:2.0:1787848249.758337:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787848249.758342:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:7933:x1874694631346304:12345-0@lo:502: 00000100:00100000:2.0:1787848249.758437:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:7933:x1874694631346304:12345-0@lo:502: Request processed in 94us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.758443:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787848249.758469:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813aca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.758480:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7933:1874694631346304:0@lo:502: 00000020:01000000:2.0:1787848249.758498:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848249.758502:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848249.758503:0:7933:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787848249.758506:0:7933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787848249.758552:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787848249.758564:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787848249.758573:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.758582:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848249.758592:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787848249.758594:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ff506b3000 from 30 10000000:01000000:2.0:1787848249.758596:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787848249.758617:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.758624:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.758632:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848249.758674:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631346432:0@lo:101: 00000100:00100000:2.0:1787848249.758700:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.758714:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813aca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.758725:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631346432 00000100:00100000:2.0:1787848249.758729:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631346432 00000100:00100000:2.0:1787848249.758747:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787848249.758752:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631346432:12345-0@lo:101: 00010000:00010000:2.0:1787848249.758761:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848249.758773:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff413a0600/0x9aeb41e0543cb45c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb455 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.758792:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff413a0600/0x9aeb41e0543cb45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb455 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.758801:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff413a0600/0x9aeb41e0543cb45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb455 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.758810:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff413a0600, rc 0) 00000100:00100000:2.0:1787848249.758837:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631346432:12345-0@lo:101: Request processed in 84us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.758844:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787848249.758872:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631346432:0@lo:101: 00010000:00010000:2.0:1787848249.758882:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.758891:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848249.758935:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631346560:0@lo:501: 00000100:00100000:2.0:1787848249.758957:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.758968:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813aca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.758978:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631346560 00000100:00100000:2.0:1787848249.758981:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631346560 00000100:00100000:2.0:1787848249.758999:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787848249.759005:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631346560:12345-0@lo:501: 00000100:00100000:2.0:1787848249.764867:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631346560:12345-0@lo:501: Request processed in 5852us (5899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.764883:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787848249.764940:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631346560:0@lo:501: 00000100:00100000:2.0:1787848249.764998:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631346688:0@lo:503: 00000100:00100000:2.0:1787848249.765058:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.765093:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813aca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.765114:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631346688 00000100:00100000:2.0:1787848249.765120:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631346688 00000100:00100000:2.0:1787848249.765168:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787848249.765178:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631346688:12345-0@lo:503: 00000100:00100000:2.0:1787848249.765348:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631346688:12345-0@lo:503: Request processed in 171us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.765356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787848249.765400:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631346688:0@lo:503: 00000100:00100000:2.0:1787848249.765622:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7934:1874694631346816:0@lo:502: 00000100:00100000:2.0:1787848249.765699:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.765731:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631346816 00000100:00100000:2.0:1787848249.765735:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631346816 00000100:00100000:2.0:1787848249.765758:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787848249.765765:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:7934:x1874694631346816:12345-0@lo:502: 00000100:00100000:2.0:1787848249.765938:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:7934:x1874694631346816:12345-0@lo:502: Request processed in 174us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.765945:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787848249.765973:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff430dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.765986:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7934:1874694631346816:0@lo:502: 00000100:00100000:2.0:1787848249.766024:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7934:1874694631346944:0@lo:502: 00000100:00100000:2.0:1787848249.766057:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.766075:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631346944 00000100:00100000:2.0:1787848249.766078:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631346944 00000100:00100000:2.0:1787848249.766097:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787848249.766103:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:7934:x1874694631346944:12345-0@lo:502: 00000100:00100000:2.0:1787848249.766227:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:7934:x1874694631346944:12345-0@lo:502: Request processed in 124us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.766234:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787848249.766260:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff430dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.766272:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7934:1874694631346944:0@lo:502: 00000040:00080000:2.0:1787848249.766289:0:7934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787848249.766335:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787848249.766351:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787848249.766360:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.766372:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848249.766389:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787848249.766392:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ff506b3000 from 5 10000000:01000000:2.0:1787848249.766395:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787848249.766420:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.766428:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.766438:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848249.766449:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631347072:0@lo:101: 00000100:00100000:2.0:1787848249.766473:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.766486:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff430dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.766498:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631347072 00000100:00100000:2.0:1787848249.766502:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631347072 00000100:00100000:2.0:1787848249.766523:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787848249.766529:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631347072:12345-0@lo:101: 00010000:00010000:2.0:1787848249.766538:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848249.766550:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff413a1c00/0x9aeb41e0543cb46a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb463 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.766569:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff413a1c00/0x9aeb41e0543cb46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb463 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.766578:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff413a1c00/0x9aeb41e0543cb46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb463 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.766597:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff413a1c00, rc 0) 00000100:00100000:2.0:1787848249.766626:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631347072:12345-0@lo:101: Request processed in 96us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.766632:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787848249.766685:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631347072:0@lo:101: 00010000:00010000:2.0:1787848249.766696:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.766704:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848249.766745:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631347200:0@lo:256: 00000100:00100000:2.0:1787848249.766774:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.766786:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff430dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.766798:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631347200 00000100:00100000:2.0:1787848249.766800:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631347200 00000100:00100000:2.0:1787848249.766818:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787848249.766823:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631347200:12345-0@lo:256: 20000000:01000000:2.0:1787848249.766836:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787848249.766852:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787848249.766855:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787848249.766922:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631347200:12345-0@lo:256: Request processed in 99us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.766929:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787848249.766954:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631347200:0@lo:256: 10000000:01000000:2.0:1787848249.766991:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787848249.767001:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.767009:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848249.767016:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787848249.767018:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787848249.767020:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787848249.767047:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.767054:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.767062:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848249.767073:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631347328:0@lo:101: 00000100:00100000:2.0:1787848249.767098:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.767110:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff430dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.767120:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631347328 00000100:00100000:2.0:1787848249.767123:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631347328 00000100:00100000:2.0:1787848249.767143:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787848249.767149:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631347328:12345-0@lo:101: 00010000:00010000:2.0:1787848249.767169:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848249.767179:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cb478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb471 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.767192:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cb478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb471 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.767207:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cb478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb471 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.767214:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664400, rc 0) 00000100:00100000:2.0:1787848249.767241:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631347328:12345-0@lo:101: Request processed in 92us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.767247:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787848249.767274:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631347328:0@lo:101: 00010000:00010000:2.0:1787848249.767285:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.767293:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848249.767329:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631347456:0@lo:501: 00000100:00100000:2.0:1787848249.767351:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.767363:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff430dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.767373:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631347456 00000100:00100000:2.0:1787848249.767377:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631347456 00000100:00100000:2.0:1787848249.767397:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787848249.767403:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631347456:12345-0@lo:501: 00000100:00100000:2.0:1787848249.767616:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631347456:12345-0@lo:501: Request processed in 213us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.767624:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787848249.767678:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631347456:0@lo:501: 00000100:00100000:2.0:1787848249.767701:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631347584:0@lo:503: 00000100:00100000:2.0:1787848249.767738:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.767750:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.767761:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631347584 00000100:00100000:2.0:1787848249.767764:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631347584 00000100:00100000:2.0:1787848249.767783:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787848249.767788:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631347584:12345-0@lo:503: 00000100:00100000:2.0:1787848249.768057:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631347584:12345-0@lo:503: Request processed in 267us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.768063:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787848249.768099:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631347584:0@lo:503: 00000100:00100000:3.0:1787848249.769547:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7935:1874694631347712:0@lo:502: 00000100:00100000:3.0:1787848249.769605:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848249.769669:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.769776:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631347712 00000100:00100000:2.0:1787848249.769782:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631347712 00000100:00100000:2.0:1787848249.769826:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787848249.769834:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:7935:x1874694631347712:12345-0@lo:502: 00000100:00100000:2.0:1787848249.770111:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:7935:x1874694631347712:12345-0@lo:502: Request processed in 278us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.770119:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787848249.770224:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7935:1874694631347712:0@lo:502: 00000020:01000000:3.0:1787848249.770249:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787848249.770256:0:7935:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787848249.770262:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848249.770265:0:7935:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787848249.770270:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787848249.770273:0:7935:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.126@tcp to nid 0x20000c0a8c97e (192.168.201.126@tcp) 00000020:01000000:3.0:1787848249.770294:0:7935:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787848249.770296:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787848249.770310:0:7935:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93ff7fcc8000) 00000020:00000080:3.0:1787848249.770329:0:7935:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787848249.770333:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787848249.770394:0:7935:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787848249.770398:0:7935:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787848249.770406:0:7935:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cb486 00010000:00080000:3.0:1787848249.770431:0:7935:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93fe41341800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:2.0:1787848249.772980:0:7935:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787848249.773333:0:7935:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787848249.773345:0:7935:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787848249.775124:0:7935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787848249.775357:0:7935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787848249.775410:0:7935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787848249.776663:0:7935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787848249.781452:0:7936:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787848249.781462:0:7936:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787848249.782896:0:7935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787848249.782909:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787848249.782940:0:7935:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787848249.782962:0:7935:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aeb41e0543cb48d 00000100:00080000:2.0:1787848249.782985:0:7935:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787848249.782991:0:7935:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93fe41341800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787848249.783152:0:7935:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff58d0a580 x1874694631347840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787848249.783184:0:7935:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787848249.783240:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848249.783245:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848249.783247:0:7935:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787848249.783250:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787848249.783254:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848249.783255:0:7935:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787848249.783258:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787848249.783260:0:7935:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787848249.783288:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7935:1874694631347968:0@lo:502: 00000100:00100000:2.0:1787848249.783367:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.783407:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631347968 00000100:00100000:2.0:1787848249.783413:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631347968 00000100:00100000:2.0:1787848249.783452:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787848249.783461:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:7935:x1874694631347968:12345-0@lo:502: 00000100:00100000:2.0:1787848249.784383:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:7935:x1874694631347968:12345-0@lo:502: Request processed in 920us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.784392:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787848249.784451:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787848249.785389:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631347840:0@lo:8: 00000100:00100000:3.0:1787848249.785449:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848249.785566:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631348096:0@lo:400: 00000100:00100000:3.0:1787848249.785595:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848249.785617:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787848249.785623:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631348224:0@lo:400: 00000100:00100000:3.0:1787848249.785673:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848249.785701:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631348352:0@lo:400: 00000100:00100000:3.0:1787848249.785725:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848249.785744:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848249.785750:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631348480:0@lo:400: 00000100:00100000:3.0:1787848249.785771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848249.785797:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631347840 00000100:00100000:3.0:1787848249.785803:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631347840 00000100:00100000:3.0:1787848249.785827:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631348352 00000100:00100000:3.0:1787848249.785830:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631348352 00000100:00100000:3.0:1787848249.785851:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787848249.785857:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631348352:12345-0@lo:400: 00000100:00100000:3.0:1787848249.785899:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631348352:12345-0@lo:400: Request processed in 42us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848249.785907:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787848249.785919:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787848249.785923:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874694631347840:12345-0@lo:8: 00010000:00080000:3.0:1787848249.785945:0:6689:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1787848249.785975:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aeb41e0543cb494 00002000:00100000:3.0:1787848249.785992:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93fe41347000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113956 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787848249.785996:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1787848249.786008:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787848249.786163:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787848249.786326:0:6689:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787848249.786350:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93fe41349000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787848249.786390:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874694631347840:12345-0@lo:8: Request processed in 466us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848249.786396:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787848249.786417:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631348096 00000100:00100000:3.0:1787848249.786420:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631348096 00000100:00100000:3.0:1787848249.786443:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631348224 00000100:00100000:3.0:1787848249.786445:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631348224 00000100:00100000:3.0:1787848249.786456:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631348480 00000100:00100000:3.0:1787848249.786459:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631348480 00000100:00100000:2.0:1787848249.786559:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:7935:1874694631347968:0@lo:502: 00000020:01000000:2.0:1787848249.786603:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848249.786609:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848249.786612:0:7935:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787848249.786617:0:7935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787848249.786691:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787848249.786718:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787848249.786728:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.786738:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848249.786748:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787848249.786751:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93ff520ab3a0 from 1 10000000:01000000:2.0:1787848249.786754:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787848249.786783:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.786791:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.786798:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848249.786812:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631348608:0@lo:101: 00000100:00100000:2.0:1787848249.786847:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.786873:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.786886:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631348608 00000100:00100000:2.0:1787848249.786889:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631348608 00000100:00100000:2.0:1787848249.786915:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787848249.786921:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631348608:12345-0@lo:101: 00010000:00010000:2.0:1787848249.786929:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848249.786939:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50664800/0x9aeb41e0543cb4a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb49b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.786970:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50664800/0x9aeb41e0543cb4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb49b expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.786979:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50664800/0x9aeb41e0543cb4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb49b expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.786986:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664800, rc 0) 00000100:00100000:2.0:1787848249.787015:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631348608:12345-0@lo:101: Request processed in 94us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.787020:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787848249.787057:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631348608:0@lo:101: 00010000:00010000:2.0:1787848249.787068:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.787076:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848249.787116:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631348736:0@lo:501: 00000100:00100000:2.0:1787848249.787138:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.787151:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.787175:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631348736 00000100:00100000:2.0:1787848249.787179:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631348736 00000100:00100000:2.0:1787848249.787201:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787848249.787207:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631348736:12345-0@lo:501: 00000100:00100000:2.0:1787848249.787401:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631348736:12345-0@lo:501: Request processed in 194us (262us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787848249.787409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787848249.787444:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631348736:0@lo:501: 10000000:01000000:2.0:1787848249.787463:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00000100:00100000:3.0:1787848249.789612:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787848249.789633:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631348096:12345-0@lo:400: 00000100:00100000:3.0:1787848249.789744:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631348096:12345-0@lo:400: Request processed in 121us (4147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848249.789751:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787848249.789769:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787848249.789776:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631348224:12345-0@lo:400: 00000100:00100000:3.0:1787848249.789807:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631348224:12345-0@lo:400: Request processed in 32us (4133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848249.789813:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787848249.789825:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787848249.789833:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631348480:12345-0@lo:400: 00000100:00100000:3.0:1787848249.789859:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631348480:12345-0@lo:400: Request processed in 28us (4087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848249.789864:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787848249.789954:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff559b2940 x1874694631348480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848249.789968:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631348480:0@lo:400: 00010000:00080000:3.0:1787848249.789982:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff559b3840 x1874694631348352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848249.789990:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631348352:0@lo:400: 00010000:00080000:3.0:1787848249.790026:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff559b3c00 x1874694631348224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848249.790035:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631348224:0@lo:400: 00010000:00080000:3.0:1787848249.790045:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff559b3480 x1874694631348096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848249.790053:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631348096:0@lo:400: 00010000:00080000:3.0:1787848249.790081:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0a580 x1874694631347840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787848259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848249.790088:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787848249.790097:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787848249.790105:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787848249.790110:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787848249.790114:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93fe41341800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787848249.790128:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787848249.790133:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631347840:0@lo:8: 00000004:00080000:3.0:1787848249.790164:0:7936:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787848249.790309:0:7936:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 198701668523ns, next at 0ns, rc = 0 00010000:00010000:2.0:1787848249.792109:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848249.792123:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787848249.895599:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787848249.895749:0:7937:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787848249.895780:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1874694631348992:0@lo:7: 00000100:00100000:2.0:1787848249.895858:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.895910:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.895926:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631348864:0@lo:13: 00000100:00100000:2.0:1787848249.895950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.895988:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631348992 00000100:00100000:2.0:1787848249.895994:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631348992 00000100:00100000:2.0:1787848249.896812:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787848249.896827:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7937:x1874694631348992:12345-0@lo:7: 00000100:00100000:3.0:1787848249.897694:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631348864 00000100:00100000:3.0:1787848249.897709:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631348864 00000100:00100000:3.0:1787848249.897761:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787848249.897771:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874694631348864:12345-0@lo:13: 00002000:00000024:3.0:1787848249.897801:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:1.0:1787848249.902257:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787848249.916197:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874694631348864:12345-0@lo:13: Request processed in 18416us (20235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848249.916213:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787848249.918103:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0b840 x1874694631348864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848249.918134:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631348864:0@lo:13: 00002000:00080000:2.0:1787848249.924718:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787848249.924729:0:6689:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787848249.924851:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7937:x1874694631348992:12345-0@lo:7: Request processed in 28021us (28984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848249.924864:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787848249.925849:0:7937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d09a40 x1874694631348992/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787848265 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848249.925866:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1874694631348992:0@lo:7: 00000004:00080000:3.0:1787848249.925882:0:7937:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787848249.925930:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1874694631349120:0@lo:5: 00000100:00100000:3.0:1787848249.925978:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848249.926026:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.926032:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631349120 00000100:00100000:2.0:1787848249.926040:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631349120 00000100:00100000:2.0:1787848249.926105:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787848249.926116:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7937:x1874694631349120:12345-0@lo:5: 00002000:00080000:2.0:1787848249.926165:0:6690:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787848249.926169:0:6690:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787848249.926478:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7937:x1874694631349120:12345-0@lo:5: Request processed in 351us (486us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787848249.926486:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787848249.926519:0:7937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5317f840 x1874694631349120/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787848265 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848249.926529:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1874694631349120:0@lo:5: 00000004:00080000:2.0:1787848249.926537:0:7937:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787848249.926561:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1874694631349248:0@lo:700: 00000100:00100000:2.0:1787848249.926585:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.926603:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6f8ea780 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.926620:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631349248 00000100:00100000:2.0:1787848249.926623:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631349248 00000100:00100000:2.0:1787848249.926676:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787848249.926684:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7937:x1874694631349248:12345-0@lo:700: 00000100:00100000:2.0:1787848249.926713:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6698:1874694631349376:0@lo:700: 00000100:00100000:2.0:1787848249.926743:0:6698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848249.926759:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff430dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848249.926779:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631349376 00000100:00100000:2.0:1787848249.926782:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631349376 00000100:00100000:2.0:1787848249.926810:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787848249.926816:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6698:x1874694631349376:12345-0@lo:700: 40000000:02000000:2.0:1787848249.996987:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787848250.016374:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6698:x1874694631349376:12345-0@lo:700: Request processed in 89551us (89623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848250.016397:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787848250.016457:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0b0c0 x1874694631349376/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787848265 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848250.017632:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6698:1874694631349376:0@lo:700: 40000000:02000000:2.0:1787848250.017666:0:6698:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1787848250.182073:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7937:x1874694631349248:12345-0@lo:700: Request processed in 255377us (255474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848250.182090:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787848250.182179:0:7937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0a1c0 x1874694631349248/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787848265 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848250.182199:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1874694631349248:0@lo:700: 00000001:00080000:1.0:1787848250.182674:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787848250.182688:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787848250.224243:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631349504:0@lo:13: 00000100:00100000:0.0:1787848250.224320:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848250.224423:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631349504 00000100:00100000:0.0:1787848250.224431:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631349504 00000100:00100000:0.0:1787848250.224607:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787848250.224616:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631349504:12345-0@lo:13: 00002000:00000024:0.0:1787848250.224670:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848250.224717:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631349504:12345-0@lo:13: Request processed in 103us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848250.224725:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787848250.224746:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787848250.224776:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff559b0000 x1874694631349504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848250.224803:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631349504:0@lo:13: 00000004:02000040:2.0:1787848250.251896:0:7937:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787848250.262884:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1874694631349632:0@lo:5: 00000100:00100000:3.0:1787848250.262963:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848250.263019:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787848250.264855:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631349632 00000100:00100000:2.0:1787848250.264874:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631349632 00000100:00100000:2.0:1787848250.264954:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848250.264964:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7937:x1874694631349632:12345-0@lo:5: 00002000:00080000:0.0:1787848250.284820:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787848250.284845:0:6689:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787848250.295595:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7937:x1874694631349632:12345-0@lo:5: Request processed in 30624us (32623us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787848250.295610:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787848250.302493:0:7937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5317e580 x1874694631349632/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787848266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848250.302514:0:7937:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787848250.302536:0:7937:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93ff5317e580 x1874694631349632/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787848266 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848250.302550:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1874694631349632:0@lo:5: 00000004:00080000:3.0:1787848250.302595:0:7937:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787848250.351843:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848251.376421:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787848251.613997:0:8006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787848252.424677:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848253.490452:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848254.512374:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848254.833361:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631350144:0@lo:400: 00000100:00100000:2.0:1787848254.833366:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631350016:0@lo:400: 00000100:00100000:1.0:1787848254.833446:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631349888:0@lo:400: 00000100:00100000:3.0:1787848254.833502:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631349760:0@lo:400: 00000100:00100000:2.0:1787848254.834532:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848254.834658:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631350016 00000100:00100000:2.0:1787848254.834665:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631350016 00000100:00100000:2.0:1787848254.834720:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787848254.834731:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631350016:12345-0@lo:400: 00000100:00100000:2.0:1787848254.834785:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631350016:12345-0@lo:400: Request processed in 57us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848254.834810:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787848254.834831:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848254.835298:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848254.835324:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631350400:0@lo:400: 00000100:00100000:1.0:1787848254.835350:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848254.835385:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631350400 00000100:00100000:1.0:1787848254.835389:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631350400 00000100:00100000:1.0:1787848254.835424:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787848254.835431:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631350400:12345-0@lo:400: 00000100:00100000:1.0:1787848254.835466:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631350400:12345-0@lo:400: Request processed in 37us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848254.835472:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787848254.835509:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff55bdd680 x1874694631350400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848254.835522:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631350400:0@lo:400: 00000100:00100000:1.0:1787848254.835558:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631349888 00000100:00100000:1.0:1787848254.835561:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631349888 00000100:00100000:1.0:1787848254.835585:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787848254.835586:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d09a40 x1874694631350016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848254.835591:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631349888:12345-0@lo:400: 00000100:00100000:2.0:1787848254.835599:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631350016:0@lo:400: 00000100:00080000:2.0:1787848254.835618:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787848254.835624:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631349888:12345-0@lo:400: Request processed in 34us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848254.835630:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787848254.835668:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0b0c0 x1874694631349888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848254.835677:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631349888:0@lo:400: 00000100:00100000:3.0:1787848254.836280:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848254.836319:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631350272:0@lo:400: 00000100:00100000:3.0:1787848254.836346:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848254.836450:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631349760 00000100:00100000:2.0:1787848254.836455:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631349760 00000100:00100000:2.0:1787848254.836501:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787848254.836509:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631349760:12345-0@lo:400: 00000100:00100000:2.0:1787848254.836548:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631349760:12345-0@lo:400: Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848254.836554:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787848254.836634:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631349760:0@lo:400: 00000100:00100000:1.0:1787848254.836895:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631350272 00000100:00100000:1.0:1787848254.836900:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631350272 00000100:00080000:2.0:1787848254.837085:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848254.837257:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787848254.837267:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631350272:12345-0@lo:400: 00000100:00100000:1.0:1787848254.837322:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631350272:12345-0@lo:400: Request processed in 58us (975us total) trans 0 rc 0/0 00010000:00080000:2.0:1787848254.837379:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff55bdf0c0 x1874694631350272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848254.837391:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631350272:0@lo:400: 00000100:00100000:0.0:1787848254.837698:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848254.837794:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631350144 00000100:00100000:2.0:1787848254.837799:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631350144 00000100:00100000:2.0:1787848254.837845:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848254.837853:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631350144:12345-0@lo:400: 00000100:00100000:2.0:1787848254.837909:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631350144:12345-0@lo:400: Request processed in 58us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848254.837915:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787848254.838147:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787848254.838171:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0b840 x1874694631350144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848254.838183:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631350144:0@lo:400: 00000100:00100000:1.0:1787848254.838425:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787848255.343856:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631350528:0@lo:13: 00000100:00100000:2.0:1787848255.343961:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848255.344042:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631350528 00000100:00100000:1.0:1787848255.344053:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631350528 00000100:00100000:1.0:1787848255.344120:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787848255.344142:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631350528:12345-0@lo:13: 00002000:00000024:1.0:1787848255.344188:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848255.346281:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631350528:12345-0@lo:13: Request processed in 2140us (2309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848255.346294:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787848255.350936:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631350656:0@lo:13: 00000100:00100000:0.0:1787848255.351021:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848255.351083:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631350656 00000100:00100000:1.0:1787848255.351094:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631350656 00000100:00100000:1.0:1787848255.351162:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787848255.351173:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631350656:12345-0@lo:13: 00002000:00000024:1.0:1787848255.351216:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848255.351263:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631350656:12345-0@lo:13: Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848255.351270:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787848255.351313:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff559b30c0 x1874694631350656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848255.351333:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631350656:0@lo:13: 00010000:00080000:2.0:1787848255.354111:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5317e940 x1874694631350528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848255.354138:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631350528:0@lo:13: 00000001:00080000:0.0:1787848255.486812:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1787848255.544274:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848256.560668:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848257.585697:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848258.611600:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848259.215805:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848259.215933:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611403136 00000100:00100000:0.0:1787848259.215946:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611403136 00000100:00100000:0.0:1787848259.216020:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:0.0:1787848259.216031:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1874694611403136:12345-192.168.201.26@tcp:250: 00010000:00080000:0.0:1787848259.216073:0:5836:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 0b6bbff9-6edf-442f-a60a-abc2c14840e9@192.168.201.26@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:0.0:1787848259.216112:0:5836:0:(genops.c:1385:class_connect()) connect: client 0b6bbff9-6edf-442f-a60a-abc2c14840e9, cookie 0x9aeb41e0543cb4a9 00000100:00080000:0.0:1787848259.216265:0:5836:0:(import.c:65:import_set_state_nolock()) ffff93ff79397800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787848259.216367:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+5:2350:x1874694611403136:12345-192.168.201.26@tcp:250: Request processed in 335us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848259.216377:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:0.0:1787848259.236056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848259.242747:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611403008 00000100:00100000:3.0:1787848259.242766:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611403008 00000100:00100000:3.0:1787848259.242999:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:3.0:1787848259.243012:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+5:5582:x1874694611403008:12345-192.168.201.26@tcp:101: 00010000:00010000:3.0:1787848259.243032:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848259.243051:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c6c00/0x9aeb41e0543cb4b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb0bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848259.243093:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c6c00/0x9aeb41e0543cb4b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0bb expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848259.243106:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c6c00/0x9aeb41e0543cb4b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0bb expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848259.243116:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c6c00, rc 0) 00000100:00100000:3.0:1787848259.243357:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+6:5582:x1874694611403008:12345-192.168.201.26@tcp:101: Request processed in 347us (7390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848259.243384:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:2.0:1787848259.262024:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848259.263818:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611403264 00000100:00100000:0.0:1787848259.263833:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611403264 00000100:00100000:0.0:1787848259.263901:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 115 00000100:00100000:0.0:1787848259.263911:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+6:5582:x1874694611403264:12345-192.168.201.26@tcp:501: 00000100:00100000:1.0:1787848259.266506:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+6:5582:x1874694611403264:12345-192.168.201.26@tcp:501: Request processed in 2585us (4480us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787848259.266521:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 115 00000100:00100000:2.0:1787848259.283930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848259.284060:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611403392 00000100:00100000:3.0:1787848259.284070:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611403392 00000100:00100000:3.0:1787848259.284128:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 116 00000100:00100000:3.0:1787848259.284146:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+6:5582:x1874694611403392:12345-192.168.201.26@tcp:101: 00010000:00010000:3.0:1787848259.284171:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848259.284189:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c6e00/0x9aeb41e0543cb4b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb0c2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848259.284220:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c6e00/0x9aeb41e0543cb4b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0c2 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848259.284230:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c6e00/0x9aeb41e0543cb4b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0c2 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848259.284238:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c6e00, rc 0) 00000100:00100000:3.0:1787848259.284292:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+7:5582:x1874694611403392:12345-192.168.201.26@tcp:101: Request processed in 148us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848259.284308:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 116 00000100:00100000:0.0:1787848259.290553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848259.290680:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611403520 00000100:00100000:1.0:1787848259.290691:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611403520 00000100:00100000:1.0:1787848259.290752:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00100000:1.0:1787848259.290762:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+7:5582:x1874694611403520:12345-192.168.201.26@tcp:501: 00000100:00100000:1.0:1787848259.291841:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:5582:x1874694611403520:12345-192.168.201.26@tcp:501: Request processed in 1076us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848259.291851:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00100000:0.0:1787848259.304476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848259.304761:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611403648 00000100:00100000:2.0:1787848259.304770:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611403648 00000100:00100000:2.0:1787848259.304827:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 118 00000100:00100000:2.0:1787848259.304838:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:5582:x1874694611403648:12345-192.168.201.26@tcp:503: 00000100:00100000:2.0:1787848259.306117:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:5582:x1874694611403648:12345-192.168.201.26@tcp:503: Request processed in 1276us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848259.306138:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 118 00000100:00100000:2.0:1787848259.331092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848259.331816:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611403776 00000100:00100000:1.0:1787848259.331827:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611403776 00000100:00100000:1.0:1787848259.331891:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 119 00000100:00100000:1.0:1787848259.331902:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:5601:x1874694611403776:12345-192.168.201.26@tcp:502: 00000100:00100000:1.0:1787848259.334819:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:5601:x1874694611403776:12345-192.168.201.26@tcp:502: Request processed in 2906us (3726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848259.334837:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 119 00000100:00100000:1.0:1787848259.389976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848259.390336:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611403904 00000100:00100000:2.0:1787848259.390347:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611403904 00000100:00100000:2.0:1787848259.390408:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 120 00000100:00100000:2.0:1787848259.390418:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:5601:x1874694611403904:12345-192.168.201.26@tcp:502: 00000100:00100000:2.0:1787848259.390996:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:5601:x1874694611403904:12345-192.168.201.26@tcp:502: Request processed in 568us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848259.391005:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 120 00000100:00100000:0.0:1787848259.416239:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848259.416448:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611404032 00000100:00100000:1.0:1787848259.416461:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611404032 00000100:00100000:1.0:1787848259.416523:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:1.0:1787848259.416533:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:5582:x1874694611404032:12345-192.168.201.26@tcp:101: 00010000:00010000:1.0:1787848259.416551:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848259.416570:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff414a4400/0x9aeb41e0543cb4be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb0ec expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848259.416598:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff414a4400/0x9aeb41e0543cb4be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0ec expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848259.416627:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff414a4400/0x9aeb41e0543cb4be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0ec expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848259.416636:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff414a4400, rc 0) 00000100:00100000:1.0:1787848259.416735:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:5582:x1874694611404032:12345-192.168.201.26@tcp:101: Request processed in 204us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848259.416742:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:0.0:1787848259.422335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848259.427189:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611404160 00000100:00100000:2.0:1787848259.427212:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611404160 00000100:00100000:2.0:1787848259.427303:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00100000:2.0:1787848259.427315:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:5582:x1874694611404160:12345-192.168.201.26@tcp:256: 20000000:01000000:2.0:1787848259.427361:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787848259.427382:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787848259.427386:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787848259.427389:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787848259.427392:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787848259.440449:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:5582:x1874694611404160:12345-192.168.201.26@tcp:256: Request processed in 13125us (18112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848259.440464:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00100000:0.0:1787848259.448741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848259.448905:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611404288 00000100:00100000:3.0:1787848259.448917:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611404288 00000100:00100000:3.0:1787848259.448962:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 123 00000100:00100000:3.0:1787848259.448980:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:5582:x1874694611404288:12345-192.168.201.26@tcp:101: 00010000:00010000:3.0:1787848259.449005:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848259.449025:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c7c00/0x9aeb41e0543cb4c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb0f3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848259.449075:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c7c00/0x9aeb41e0543cb4c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0f3 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848259.449087:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c7c00/0x9aeb41e0543cb4c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0f3 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848259.449097:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c7c00, rc 0) 00000100:00100000:3.0:1787848259.449167:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5582:x1874694611404288:12345-192.168.201.26@tcp:101: Request processed in 197us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848259.449173:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 123 00000100:00100000:2.0:1787848259.464049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848259.464173:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611404416 00000100:00100000:0.0:1787848259.464185:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611404416 00000100:00100000:0.0:1787848259.464244:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 124 00000100:00100000:0.0:1787848259.464255:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5582:x1874694611404416:12345-192.168.201.26@tcp:501: 00000100:00100000:0.0:1787848259.464927:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5582:x1874694611404416:12345-192.168.201.26@tcp:501: Request processed in 671us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848259.464936:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 124 00000100:00100000:2.0:1787848259.472016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848259.472120:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611404544 00000100:00100000:1.0:1787848259.472130:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611404544 00000100:00100000:1.0:1787848259.472194:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:1.0:1787848259.472205:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5582:x1874694611404544:12345-192.168.201.26@tcp:503: 00000100:00100000:1.0:1787848259.472594:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5582:x1874694611404544:12345-192.168.201.26@tcp:503: Request processed in 390us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848259.472601:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:2.0:1787848259.481419:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848259.481618:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611404672 00000100:00100000:3.0:1787848259.481629:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611404672 00000100:00100000:3.0:1787848259.481737:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:3.0:1787848259.481747:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5605:x1874694611404672:12345-192.168.201.26@tcp:502: 00000100:00100000:3.0:1787848259.482085:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5605:x1874694611404672:12345-192.168.201.26@tcp:502: Request processed in 338us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848259.482093:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:2.0:1787848259.489890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848259.490036:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611404800 00000100:00100000:0.0:1787848259.490050:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611404800 00000100:00100000:0.0:1787848259.490116:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 127 00000100:00100000:0.0:1787848259.490127:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5605:x1874694611404800:12345-192.168.201.26@tcp:502: 00000100:00100000:0.0:1787848259.490888:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5605:x1874694611404800:12345-192.168.201.26@tcp:502: Request processed in 759us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848259.490909:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 127 00000100:00100000:2.0:1787848259.499049:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848259.504076:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611404928 00000100:00100000:3.0:1787848259.504093:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611404928 00000100:00100000:0.0:1787848259.511553:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:0.0:1787848259.511567:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1874694611404928:12345-192.168.201.26@tcp:38: 00010000:00080000:0.0:1787848259.511607:0:5842:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:0.0:1787848259.511706:0:5842:0:(genops.c:1385:class_connect()) connect: client 8bb0bb0f-4511-40a8-bdfa-25f441891529, cookie 0x9aeb41e0543cb4cc 00000004:00100000:0.0:1787848259.511742:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787848259.511749:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787848259.591818:0:5842:0:(import.c:65:import_set_state_nolock()) ffff93ff79392800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787848259.591904:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2350:x1874694611404928:12345-192.168.201.26@tcp:38: Request processed in 80335us (92865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848259.591915:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00010000:00010000:1.0:1787848259.642829:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848259.953522:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631350784:0@lo:400: 00000100:00100000:3.0:1787848259.953609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848259.953923:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631350784 00000100:00100000:1.0:1787848259.953934:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631350784 00000100:00100000:1.0:1787848259.954018:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787848259.954030:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631350784:12345-0@lo:400: 00000100:00100000:0.0:1787848259.957751:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631350912:0@lo:400: 00000100:00100000:0.0:1787848259.957847:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848259.957958:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631350912 00000100:00100000:0.0:1787848259.957986:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631350912 00000100:00100000:0.0:1787848259.958048:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787848259.958058:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631350912:12345-0@lo:400: 00000100:00100000:0.0:1787848259.958120:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631350912:12345-0@lo:400: Request processed in 63us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848259.958127:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787848259.958186:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d09a40 x1874694631350912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848259.958200:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631350912:0@lo:400: 00000100:00100000:1.0:1787848259.959418:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631350784:12345-0@lo:400: Request processed in 5385us (5803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848259.959430:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787848259.959747:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631351424:0@lo:400: 00000100:00100000:0.0:1787848259.959867:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631351040:0@lo:400: 00000100:00100000:1.0:1787848259.959926:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631351168:0@lo:400: 00000100:00100000:0.0:1787848259.964705:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848259.964817:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631351040 00000100:00100000:0.0:1787848259.964827:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631351040 00000100:00100000:0.0:1787848259.964886:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787848259.964896:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631351040:12345-0@lo:400: 00000100:00100000:0.0:1787848259.964960:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631351040:12345-0@lo:400: Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848259.966072:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787848259.966114:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787848259.966281:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d09a40 x1874694631351040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848259.966304:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631351040:0@lo:400: 00000100:00100000:3.0:1787848259.967707:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631350784:0@lo:400: 00000100:00100000:3.0:1787848259.967741:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631351296:0@lo:400: 00000100:00100000:3.0:1787848259.969914:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848259.970995:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631351296 00000100:00100000:0.0:1787848259.971010:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631351296 00000100:00100000:0.0:1787848259.971089:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787848259.971100:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631351296:12345-0@lo:400: 00000100:00100000:0.0:1787848259.971369:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631351296:12345-0@lo:400: Request processed in 270us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848259.971377:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787848259.971597:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787848259.971741:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb4a940 x1874694631351296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848259.971757:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631351296:0@lo:400: 00000100:00100000:2.0:1787848259.971921:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848259.972091:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631351424 00000100:00100000:3.0:1787848259.972097:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631351424 00000100:00100000:3.0:1787848259.972263:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787848259.972274:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631351424:12345-0@lo:400: 00000100:00100000:3.0:1787848259.972392:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631351424:12345-0@lo:400: Request processed in 122us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848259.972398:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787848259.972457:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787848259.972601:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb48b40 x1874694631351424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848259.972611:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787848259.972623:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631351424:0@lo:400: 00000100:00100000:1.0:1787848259.972883:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848259.973049:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631351168 00000100:00100000:3.0:1787848259.973055:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631351168 00000100:00100000:3.0:1787848259.973160:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787848259.973169:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80748780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631351168:12345-0@lo:400: 00000100:00100000:3.0:1787848259.973230:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80748780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631351168:12345-0@lo:400: Request processed in 63us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848259.973237:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787848259.973698:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb4b0c0 x1874694631351168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848259.973709:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631351168:0@lo:400: 00000100:00080000:0.0:1787848259.974126:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848260.465245:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787848260.465278:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631351552:0@lo:13: 00000100:00100000:2.0:1787848260.465355:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848260.465506:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631351552 00000100:00100000:1.0:1787848260.465539:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631351552 00000100:00100000:1.0:1787848260.465594:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787848260.465603:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631351552:12345-0@lo:13: 00002000:00000024:1.0:1787848260.465659:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848260.465715:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631351552:12345-0@lo:13: Request processed in 113us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848260.465721:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787848260.466073:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631351680:0@lo:13: 00000100:00100000:2.0:1787848260.466103:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787848260.466165:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff559b3c00 x1874694631351552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848260.466194:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631351552:0@lo:13: 00000100:00100000:0.0:1787848260.466269:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631351680 00000100:00100000:0.0:1787848260.466273:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631351680 00000100:00100000:0.0:1787848260.466309:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787848260.466317:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631351680:12345-0@lo:13: 00002000:00000024:0.0:1787848260.466342:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848260.466392:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631351680:12345-0@lo:13: Request processed in 76us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848260.466404:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787848260.466478:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5317c3c0 x1874694631351680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848260.466492:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631351680:0@lo:13: 00000100:00100000:2.0:1787848260.597917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848260.598020:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611405056 00000100:00100000:0.0:1787848260.598032:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611405056 00000100:00100000:0.0:1787848260.598124:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:0.0:1787848260.598136:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:0:x1874694611405056:12345-192.168.201.26@tcp:41: 00000004:00000024:0.0:1787848260.598191:0:7097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787848260.598270:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:0:x1874694611405056:12345-192.168.201.26@tcp:41: Request processed in 136us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848260.598279:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00080000:3.0:1787848260.598536:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848260.601796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848260.601922:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611405184 00000100:00100000:0.0:1787848260.601933:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611405184 00000100:00100000:0.0:1787848260.602178:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:0.0:1787848260.602190:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:5582:x1874694611405184:12345-192.168.201.26@tcp:41: 00000004:00000024:0.0:1787848260.602230:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787848260.602464:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:5582:x1874694611405184:12345-192.168.201.26@tcp:41: Request processed in 277us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848260.602472:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:2.0:1787848260.605634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848260.605754:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611405312 00000100:00100000:0.0:1787848260.605764:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611405312 00000100:00100000:0.0:1787848260.605822:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:0.0:1787848260.605832:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:5582:x1874694611405312:12345-192.168.201.26@tcp:40: 00000100:00100000:0.0:1787848260.605921:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:5582:x1874694611405312:12345-192.168.201.26@tcp:40: Request processed in 91us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848260.605928:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:1.0:1787848260.612985:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848260.614142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848260.614186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848260.614624:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611405440 00000100:00100000:3.0:1787848260.614635:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611405440 00000100:00100000:3.0:1787848260.614705:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611405568 00000100:00100000:3.0:1787848260.614709:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611405568 00000100:00100000:3.0:1787848260.614723:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:3.0:1787848260.614731:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874694611405440:12345-192.168.201.26@tcp:8: 00010000:00080000:3.0:1787848260.614782:0:6691:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1787848260.614812:0:6691:0:(genops.c:1385:class_connect()) connect: client 8bb0bb0f-4511-40a8-bdfa-25f441891529, cookie 0x9aeb41e0543cb4d3 00002000:00100000:3.0:1787848260.614825:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8bb0bb0f-4511-40a8-bdfa-25f441891529/ffff93ff43068800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787848260.614838:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787848260.615223:0:6691:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787848260.615255:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93ff4306b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787848260.615690:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2350:x1874694611405440:12345-192.168.201.26@tcp:8: Request processed in 957us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848260.615700:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:3.0:1787848260.615721:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:3.0:1787848260.615726:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80749e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874694611405568:12345-192.168.201.26@tcp:8: 00010000:00080000:3.0:1787848260.615745:0:6691:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1787848260.615763:0:6691:0:(genops.c:1385:class_connect()) connect: client 8bb0bb0f-4511-40a8-bdfa-25f441891529, cookie 0x9aeb41e0543cb4da 00002000:00100000:3.0:1787848260.615769:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8bb0bb0f-4511-40a8-bdfa-25f441891529/ffff93ff43068000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787848260.615776:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787848260.616009:0:6691:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787848260.616027:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93ff43069000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787848260.616050:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80749e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2350:x1874694611405568:12345-192.168.201.26@tcp:8: Request processed in 323us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848260.616056:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:3.0:1787848260.616121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848260.616670:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611405696 00000100:00100000:2.0:1787848260.616678:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611405696 00000100:00100000:2.0:1787848260.616725:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:2.0:1787848260.616734:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:5582:x1874694611405696:12345-192.168.201.26@tcp:33: 00000100:00100000:0.0:1787848260.617066:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611405824 00000100:00100000:0.0:1787848260.617077:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611405824 00000100:00100000:0.0:1787848260.617112:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 129 00000100:00100000:0.0:1787848260.617120:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611405824:12345-192.168.201.26@tcp:400: 00000100:00100000:0.0:1787848260.617176:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611405824:12345-192.168.201.26@tcp:400: Request processed in 57us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848260.617182:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 129 00000004:00080000:2.0:1787848260.648794:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32000us 00010000:00010000:3.0:1787848260.656304:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:2.0:1787848260.673030:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787848260.673525:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:5582:x1874694611405696:12345-192.168.201.26@tcp:33: Request processed in 56785us (60555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848260.673538:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:1.0:1787848260.890560:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848260.890685:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611405952 00000100:00100000:2.0:1787848260.890696:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611405952 00000100:00100000:2.0:1787848260.890769:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:2.0:1787848260.890781:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80749a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:5622:x1874694611405952:12345-192.168.201.26@tcp:101: 00010000:00010000:2.0:1787848260.890805:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848260.890834:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665600/0x9aeb41e0543cb4e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb11d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848260.890925:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb4e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848260.890940:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848260.890997:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848260.891217:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787848260.891222:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787848260.891298:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848260.891327:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665600/0x9aeb41e0543cb4e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb11d expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848260.891344:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb11d expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848260.891351:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff53a89e00) 00010000:00010000:2.0:1787848260.891354:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787848260.891358:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665000, rc 0) 00000100:00100000:2.0:1787848260.891436:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80749a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:5622:x1874694611405952:12345-192.168.201.26@tcp:101: Request processed in 657us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848260.891442:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000001:00100000:2.0:1787848261.538469:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00010000:00010000:1.0:1787848261.682389:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848262.703969:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848263.259690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848263.260007:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611406080 00000100:00100000:0.0:1787848263.260019:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611406080 00000100:00100000:0.0:1787848263.260101:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:0.0:1787848263.260112:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:5675:x1874694611406080:12345-192.168.201.26@tcp:41: 00000004:00000024:0.0:1787848263.260161:0:7097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787848263.260264:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:5675:x1874694611406080:12345-192.168.201.26@tcp:41: Request processed in 153us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848263.260273:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00080000:3.0:1787848263.261327:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848263.263629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848263.264045:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611406208 00000100:00100000:0.0:1787848263.264056:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611406208 00000100:00100000:0.0:1787848263.264130:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787848263.264141:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:5675:x1874694611406208:12345-192.168.201.26@tcp:13: 00002000:00000024:0.0:1787848263.264188:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848263.264269:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:5675:x1874694611406208:12345-192.168.201.26@tcp:13: Request processed in 129us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848263.264277:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00080000:3.0:1787848263.265211:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848263.267298:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848263.269296:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611406336 00000100:00100000:0.0:1787848263.269309:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611406336 00000100:00100000:0.0:1787848263.269395:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:0.0:1787848263.269407:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:5675:x1874694611406336:12345-192.168.201.26@tcp:13: 00002000:00000024:0.0:1787848263.269467:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787848263.269489:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787848263.269555:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:5675:x1874694611406336:12345-192.168.201.26@tcp:13: Request processed in 149us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848263.269563:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00010000:00010000:3.0:1787848263.728288:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787848264.134826:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00000001:00100000:1.0:1787848264.638553:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00010000:00010000:3.0:1787848264.759339:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848265.074092:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631352192:0@lo:400: 00000100:00100000:2.0:1787848265.074131:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631351936:0@lo:400: 00000100:00100000:1.0:1787848265.074237:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631352064:0@lo:400: 00000100:00100000:3.0:1787848265.074299:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631351808:0@lo:400: 00000100:00100000:2.0:1787848265.078059:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848265.078171:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631352448:0@lo:400: 00000100:00100000:2.0:1787848265.078232:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848265.078314:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631351936 00000100:00100000:2.0:1787848265.078340:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631351936 00000100:00100000:2.0:1787848265.078421:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787848265.078432:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631351936:12345-0@lo:400: 00000100:00100000:2.0:1787848265.078506:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631351936:12345-0@lo:400: Request processed in 75us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848265.078515:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787848265.078544:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631352448 00000100:00100000:2.0:1787848265.078549:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631352448 00000100:00100000:2.0:1787848265.078598:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787848265.078607:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631352448:12345-0@lo:400: 00000100:00100000:2.0:1787848265.078664:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631352448:12345-0@lo:400: Request processed in 35us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848265.078672:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787848265.078691:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787848265.078843:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631351936:0@lo:400: 00010000:00080000:2.0:1787848265.078858:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5399b480 x1874694631352448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848265.078870:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631352448:0@lo:400: 00000100:00100000:0.0:1787848265.079110:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848265.079399:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848265.079464:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631352064 00000100:00100000:0.0:1787848265.079470:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631352064 00000100:00100000:2.0:1787848265.079509:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631352192 00000100:00100000:2.0:1787848265.079515:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631352192 00000100:00100000:0.0:1787848265.079538:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787848265.079552:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631352064:12345-0@lo:400: 00000100:00100000:2.0:1787848265.079557:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787848265.079570:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5399b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631352192:12345-0@lo:400: 00000100:00100000:0.0:1787848265.079624:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631352064:12345-0@lo:400: Request processed in 76us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848265.079633:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5399b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631352192:12345-0@lo:400: Request processed in 66us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848265.079633:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787848265.079667:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787848265.079705:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0b0c0 x1874694631352192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848265.079719:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631352192:0@lo:400: 00000100:00080000:1.0:1787848265.079794:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787848265.079800:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848265.079824:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631352064:0@lo:400: 00000100:00100000:3.0:1787848265.082737:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848265.082916:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631352320:0@lo:400: 00000100:00100000:3.0:1787848265.082978:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848265.083683:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631352320 00000100:00100000:2.0:1787848265.083699:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631352320 00000100:00100000:2.0:1787848265.083830:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787848265.083845:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631352320:12345-0@lo:400: 00000100:00100000:2.0:1787848265.083960:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631352320:12345-0@lo:400: Request processed in 119us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848265.083970:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787848265.084036:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631352320:0@lo:400: 00000100:00080000:3.0:1787848265.084142:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848265.084326:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631351808 00000100:00100000:1.0:1787848265.084332:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631351808 00000100:00100000:1.0:1787848265.084378:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787848265.084387:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631351808:12345-0@lo:400: 00000100:00100000:1.0:1787848265.084443:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631351808:12345-0@lo:400: Request processed in 58us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848265.084450:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787848265.084672:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631351808:0@lo:400: 00000100:00100000:1.0:1787848265.584318:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631352576:0@lo:13: 00000100:00100000:1.0:1787848265.584434:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848265.584559:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631352576 00000100:00100000:0.0:1787848265.584569:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631352576 00000100:00100000:0.0:1787848265.584668:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787848265.584680:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631352576:12345-0@lo:13: 00002000:00000024:0.0:1787848265.584731:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848265.584793:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631352576:12345-0@lo:13: Request processed in 115us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848265.584801:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787848265.584863:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0b0c0 x1874694631352576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848265.584895:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631352576:0@lo:13: 00000100:00100000:1.0:1787848265.588170:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787848265.588212:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631352704:0@lo:13: 00000100:00100000:1.0:1787848265.588317:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848265.588458:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631352704 00000100:00100000:0.0:1787848265.588472:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631352704 00000100:00100000:0.0:1787848265.588543:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787848265.588554:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631352704:12345-0@lo:13: 00002000:00000024:0.0:1787848265.588605:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848265.588698:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631352704:12345-0@lo:13: Request processed in 145us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848265.588706:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787848265.588792:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0b0c0 x1874694631352704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848265.588815:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631352704:0@lo:13: 00010000:00010000:3.0:1787848265.777535:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848265.927091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848265.927146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848265.927192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848265.927218:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848265.927252:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611406720 00000100:00100000:3.0:1787848265.927265:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611406720 00000100:00100000:3.0:1787848265.927344:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611406848 00000100:00100000:3.0:1787848265.927348:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611406848 00000100:00100000:3.0:1787848265.927373:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:3.0:1787848265.927386:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2351:x1874694611406720:12345-192.168.201.26@tcp:400: 00000100:00100000:3.0:1787848265.927490:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2351:x1874694611406720:12345-192.168.201.26@tcp:400: Request processed in 106us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848265.927499:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:3.0:1787848265.927537:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:3.0:1787848265.927544:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2351:x1874694611406848:12345-192.168.201.26@tcp:400: 00000100:00100000:3.0:1787848265.927573:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2351:x1874694611406848:12345-192.168.201.26@tcp:400: Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848265.927579:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00080000:3.0:1787848265.927597:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848265.927601:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787848265.927635:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611406464 00000100:00100000:0.0:1787848265.927660:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611406464 00000100:00100000:0.0:1787848265.927701:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 131 00000100:00100000:0.0:1787848265.927711:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2351:x1874694611406464:12345-192.168.201.26@tcp:400: 00000100:00100000:0.0:1787848265.927746:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2351:x1874694611406464:12345-192.168.201.26@tcp:400: Request processed in 38us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848265.927755:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 131 00000100:00100000:0.0:1787848265.927809:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611406592 00000100:00100000:0.0:1787848265.927814:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611406592 00000100:00100000:0.0:1787848265.927863:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:0.0:1787848265.927870:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611406592:12345-192.168.201.26@tcp:400: 00000100:00100000:0.0:1787848265.927922:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611406592:12345-192.168.201.26@tcp:400: Request processed in 52us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848265.927929:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00080000:3.0:1787848265.929448:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787848266.366209:0:8312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787848266.800066:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848267.826307:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848268.848835:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848269.873847:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848270.193468:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631352960:0@lo:400: 00000100:00100000:3.0:1787848270.193545:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848270.193617:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631353472:0@lo:400: 00000100:00100000:3.0:1787848270.193685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848270.193721:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787848270.193728:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631352832:0@lo:400: 00000100:00100000:3.0:1787848270.193759:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848270.193782:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631353344:0@lo:400: 00000100:00100000:3.0:1787848270.193816:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848270.193844:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631353088:0@lo:400: 00000100:00100000:3.0:1787848270.193868:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848270.193886:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787848270.193891:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631353216:0@lo:400: 00000100:00100000:3.0:1787848270.193912:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848270.193943:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631352960 00000100:00100000:3.0:1787848270.193958:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631352960 00000100:00100000:3.0:1787848270.194005:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631353344 00000100:00100000:3.0:1787848270.194009:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631353344 00000100:00100000:3.0:1787848270.194030:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631353088 00000100:00100000:3.0:1787848270.194032:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631353088 00000100:00100000:3.0:1787848270.194047:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787848270.194055:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631352960:12345-0@lo:400: 00000100:00100000:3.0:1787848270.194106:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631352960:12345-0@lo:400: Request processed in 51us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848270.194113:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787848270.194129:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787848270.194136:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631353344:12345-0@lo:400: 00000100:00100000:3.0:1787848270.194162:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631353344:12345-0@lo:400: Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848270.194168:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787848270.194179:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787848270.194185:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631353088:12345-0@lo:400: 00000100:00100000:3.0:1787848270.194214:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631353088:12345-0@lo:400: Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848270.194220:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787848270.194236:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631353472 00000100:00100000:3.0:1787848270.194240:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631353472 00000100:00100000:3.0:1787848270.194264:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631353216 00000100:00100000:3.0:1787848270.194267:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631353216 00000100:00100000:3.0:1787848270.194279:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787848270.194285:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631353472:12345-0@lo:400: 00000100:00100000:3.0:1787848270.194314:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631353472:12345-0@lo:400: Request processed in 29us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848270.194331:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787848270.194344:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787848270.194350:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631353216:12345-0@lo:400: 00000100:00100000:3.0:1787848270.194381:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631353216:12345-0@lo:400: Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848270.194386:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787848270.194404:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631352832 00000100:00100000:3.0:1787848270.194407:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631352832 00000100:00100000:3.0:1787848270.194434:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787848270.194440:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3313:x1874694631352832:12345-0@lo:400: 00000100:00100000:3.0:1787848270.194468:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3313:x1874694631352832:12345-0@lo:400: Request processed in 28us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848270.194473:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1787848270.194508:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848270.194512:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848270.194515:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787848270.194545:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb2c000 x1874694631353216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848270.194559:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631353216:0@lo:400: 00000100:00100000:3.0:1787848270.194572:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631353088:0@lo:400: 00000100:00100000:3.0:1787848270.194600:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631352832:0@lo:400: 00000100:00100000:3.0:1787848270.194609:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631353344:0@lo:400: 00000100:00100000:3.0:1787848270.194618:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631352960:0@lo:400: 00010000:00080000:3.0:1787848270.194626:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb2cf00 x1874694631353472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848270.194669:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631353472:0@lo:400: 00000100:00100000:3.0:1787848270.704857:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631353600:0@lo:13: 00000100:00100000:3.0:1787848270.704932:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848270.705010:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631353600 00000100:00100000:3.0:1787848270.705018:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631353600 00000100:00100000:3.0:1787848270.705067:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787848270.705076:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631353600:12345-0@lo:13: 00002000:00000024:3.0:1787848270.705111:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848270.705168:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631353600:12345-0@lo:13: Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848270.705176:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787848270.705219:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0b0c0 x1874694631353600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848270.705237:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631353600:0@lo:13: 00000100:00100000:1.0:1787848270.705450:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631353728:0@lo:13: 00000100:00100000:1.0:1787848270.705484:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848270.705825:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631353728 00000100:00100000:0.0:1787848270.705843:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631353728 00000100:00100000:0.0:1787848270.705880:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787848270.705888:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631353728:12345-0@lo:13: 00002000:00000024:0.0:1787848270.705912:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848270.705958:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631353728:12345-0@lo:13: Request processed in 71us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848270.705964:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787848270.705996:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0b0c0 x1874694631353728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848270.706012:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631353728:0@lo:13: 00000020:00000080:0.0:1787848270.743369:0:8460:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd06b6a50 20000000:00000080:0.0:1787848270.743388:0:8460:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ff7fc15c00 uarg=0000000000000000 20000000:01000000:0.0:1787848270.743449:0:8460:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787848270.743452:0:8460:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787848270.743454:0:8460:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787848270.743460:0:8460:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787848270.743465:0:8460:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787848270.743478:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787848270.743481:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787848270.744342:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787848270.744348:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787848270.749916:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787848270.750624:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787848270.750713:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787848270.750751:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1787848270.750766:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787848270.750769:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787848270.752200:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787848270.753036:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787848270.753105:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787848270.753156:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787848270.753171:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787848270.753173:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787848270.760150:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787848270.765266:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787848270.765341:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787848270.765401:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787848270.766613:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787848270.766617:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787848270.769832:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787848270.770500:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787848270.770570:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787848270.770608:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1787848270.770624:0:8460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787848270.771235:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771255:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb3ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb3e5 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771263:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb40f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771270:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff413a1a00/0x9aeb41e0543cb440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb439 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771277:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff413a0800/0x9aeb41e0543cb44e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb447 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771283:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff413a0600/0x9aeb41e0543cb45c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb455 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771289:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cb478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb471 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771295:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff50664800/0x9aeb41e0543cb4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb49b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771304:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff444c6c00/0x9aeb41e0543cb4b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0bb expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771327:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff444c6e00/0x9aeb41e0543cb4b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0c2 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771334:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771372:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff444c6e00/0x9aeb41e0543cb4b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0c2 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771387:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff444c6e00/0x9aeb41e0543cb4b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0c2 expref: 9 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.771401:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631353856:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848270.771523:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff444c6c00/0x9aeb41e0543cb4b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0bb expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771534:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff444c6c00/0x9aeb41e0543cb4b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0bb expref: 9 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.771543:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631353984:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848270.771576:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff50664800/0x9aeb41e0543cb4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb49b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771585:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff50664800/0x9aeb41e0543cb4a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb49b expref: 18 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.771594:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354112:0@lo:104: 00000100:00100000:0.0:1787848270.771632:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787848270.771714:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cb478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb471 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771723:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cb478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb471 expref: 18 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.771733:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354240:0@lo:104: 00000100:00100000:0.0:1787848270.771757:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787848270.771778:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff413a0600/0x9aeb41e0543cb45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb455 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771786:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff413a0600/0x9aeb41e0543cb45c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb455 expref: 18 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.771805:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354368:0@lo:104: 00010000:00010000:0.0:1787848270.771830:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff413a0800/0x9aeb41e0543cb44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb447 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771839:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff413a0800/0x9aeb41e0543cb44e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb447 expref: 18 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.771847:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354496:0@lo:104: 00010000:00010000:0.0:1787848270.771870:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff413a1a00/0x9aeb41e0543cb440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb439 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771877:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff413a1a00/0x9aeb41e0543cb440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb439 expref: 18 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.771884:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354624:0@lo:104: 00010000:00010000:0.0:1787848270.771905:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb40f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771919:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb416 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb40f expref: 18 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.771927:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354752:0@lo:104: 00010000:00010000:0.0:1787848270.771951:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb3e5 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.771958:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb3ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb3e5 expref: 18 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.771964:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354880:0@lo:104: 00000100:00100000:0.0:1787848270.771981:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787848270.772282:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787848270.772301:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.772312:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.772320:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.772327:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.772335:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.772344:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631354112 00000100:00100000:1.0:1787848270.772351:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631354112 00000100:00100000:1.0:1787848270.772389:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631354240 00000100:00100000:1.0:1787848270.772393:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631354240 00000100:00100000:1.0:1787848270.772403:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631354368 00000100:00100000:1.0:1787848270.772405:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631354368 00000100:00100000:1.0:1787848270.772426:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631354496 00000100:00100000:1.0:1787848270.772429:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631354496 00000100:00100000:1.0:1787848270.772439:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631354624 00000100:00100000:1.0:1787848270.772441:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631354624 00000100:00100000:1.0:1787848270.772450:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631354752 00000100:00100000:1.0:1787848270.772452:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631354752 00000100:00100000:1.0:1787848270.772460:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631354880 00000100:00100000:1.0:1787848270.772468:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631354880 00000100:00100000:1.0:1787848270.772486:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787848270.772494:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:8460:x1874694631354112:12345-0@lo:104: 00010000:00010000:1.0:1787848270.772506:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.772561:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787848270.772568:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+9:8460:x1874694631354112:12345-0@lo:104: Request processed in 75us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.772574:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787848270.772591:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787848270.772597:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fa6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+8:8460:x1874694631354240:12345-0@lo:104: 00010000:00010000:1.0:1787848270.772604:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.772663:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787848270.772668:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fa6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+8:8460:x1874694631354240:12345-0@lo:104: Request processed in 73us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.772674:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787848270.772710:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787848270.772716:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80748000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+7:8460:x1874694631354368:12345-0@lo:104: 00010000:00010000:1.0:1787848270.772723:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.772750:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787848270.772755:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80748000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+7:8460:x1874694631354368:12345-0@lo:104: Request processed in 41us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.772761:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787848270.772779:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787848270.772785:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+6:8460:x1874694631354496:12345-0@lo:104: 00010000:00010000:1.0:1787848270.772804:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.772833:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787848270.772838:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+6:8460:x1874694631354496:12345-0@lo:104: Request processed in 54us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.772844:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787848270.772855:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787848270.772861:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:8460:x1874694631354624:12345-0@lo:104: 00010000:00010000:1.0:1787848270.772869:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.772892:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787848270.772897:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:8460:x1874694631354624:12345-0@lo:104: Request processed in 37us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.772902:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787848270.772912:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787848270.772917:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+4:8460:x1874694631354752:12345-0@lo:104: 00010000:00010000:1.0:1787848270.772924:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.772948:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787848270.772952:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+4:8460:x1874694631354752:12345-0@lo:104: Request processed in 36us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.772957:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787848270.772975:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787848270.772980:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:8460:x1874694631354880:12345-0@lo:104: 00010000:00010000:1.0:1787848270.772987:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773014:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787848270.773019:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:8460:x1874694631354880:12345-0@lo:104: Request processed in 39us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.773025:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787848270.773042:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787848270.773048:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773056:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665400 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848270.773060:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773069:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848270.773076:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848270.773083:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787848270.773110:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773116:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848270.773135:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773153:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cb49b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb4a2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773167:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787848270.773170:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773175:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665c00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848270.773178:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773185:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848270.773190:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848270.773195:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787848270.773209:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773214:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848270.773219:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773225:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff50665c00/0x9aeb41e0543cb471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb478 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773233:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787848270.773242:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773248:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff413a0400 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848270.773251:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773258:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848270.773263:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848270.773268:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787848270.773282:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773287:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848270.773302:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773308:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff413a0400/0x9aeb41e0543cb455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb45c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773318:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787848270.773321:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773327:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff413a1400 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848270.773330:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773348:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848270.773354:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848270.773359:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787848270.773372:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773377:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848270.773383:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773389:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff413a1400/0x9aeb41e0543cb447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb44e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773400:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787848270.773402:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773408:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031600 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848270.773410:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773416:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848270.773422:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848270.773433:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787848270.773447:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773453:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848270.773457:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773464:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff40031600/0x9aeb41e0543cb439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb440 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773473:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787848270.773476:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773481:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5c00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848270.773484:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773489:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848270.773494:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848270.773498:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787848270.773509:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773515:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848270.773526:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773532:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb40f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb416 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773541:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848270.773545:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773550:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5600 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848270.773553:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773559:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848270.773565:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848270.773570:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787848270.773583:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773589:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848270.773592:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773598:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb3e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb3ec expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.773611:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848270.773618:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848270.773620:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848270.773634:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631355008:0@lo:103: 00000100:00100000:1.0:1787848270.773695:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.773718:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631355520:0@lo:103: 00000100:00100000:1.0:1787848270.773737:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.773756:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787848270.773761:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631355136:0@lo:103: 00000100:00100000:1.0:1787848270.773781:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.773814:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631355648:0@lo:103: 00000100:00100000:1.0:1787848270.773834:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.773852:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631355392:0@lo:103: 00000100:00100000:1.0:1787848270.773873:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.773884:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787848270.773888:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631355264:0@lo:103: 00000100:00100000:1.0:1787848270.773921:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.773934:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631355776:0@lo:103: 00000100:00100000:1.0:1787848270.773955:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848270.773974:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631355008 00000100:00100000:1.0:1787848270.773979:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631355008 00010000:00010000:1.0:1787848270.774000:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff50664800/0x9aeb41e0543cb4a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb49b expref: 19 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848270.774017:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631355520 00000100:00100000:1.0:1787848270.774020:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631355520 00010000:00010000:1.0:1787848270.774029:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff413a1a00/0x9aeb41e0543cb440 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb439 expref: 20 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848270.774051:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631355136 00000100:00100000:1.0:1787848270.774054:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631355136 00010000:00010000:1.0:1787848270.774065:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cb478 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb471 expref: 21 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848270.774074:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631355648 00000100:00100000:1.0:1787848270.774077:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631355648 00010000:00010000:1.0:1787848270.774085:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb416 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb40f expref: 22 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848270.774093:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631355392 00000100:00100000:1.0:1787848270.774095:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631355392 00010000:00010000:1.0:1787848270.774104:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff413a0800/0x9aeb41e0543cb44e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb447 expref: 23 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848270.774112:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631355264 00000100:00100000:1.0:1787848270.774115:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631355264 00010000:00010000:1.0:1787848270.774122:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff413a0600/0x9aeb41e0543cb45c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb455 expref: 24 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848270.774130:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631355776 00000100:00100000:1.0:1787848270.774132:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631355776 00010000:00010000:1.0:1787848270.774138:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb3ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb3e5 expref: 25 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848270.774148:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787848270.774153:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+25:3312:x1874694631355008:12345-0@lo:103: 00010000:00010000:1.0:1787848270.774162:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848270.774167:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff50664800/0x9aeb41e0543cb4a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb49b expref: 25 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774186:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff50664800/0x9aeb41e0543cb4a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb49b expref: 25 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774203:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848270.774235:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+25:3312:x1874694631355008:12345-0@lo:103: Request processed in 82us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.774242:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787848270.774255:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787848270.774260:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+24:3312:x1874694631355520:12345-0@lo:103: 00010000:00010000:1.0:1787848270.774268:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848270.774272:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff413a1a00/0x9aeb41e0543cb440 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb439 expref: 24 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774279:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff413a1a00/0x9aeb41e0543cb440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb439 expref: 24 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774288:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848270.774309:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+24:3312:x1874694631355520:12345-0@lo:103: Request processed in 48us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.774315:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787848270.774326:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787848270.774331:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+23:3312:x1874694631355136:12345-0@lo:103: 00010000:00010000:1.0:1787848270.774338:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848270.774342:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cb478 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb471 expref: 23 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774350:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cb478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb471 expref: 23 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774366:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848270.774389:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+23:3312:x1874694631355136:12345-0@lo:103: Request processed in 57us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.774395:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787848270.774407:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787848270.774412:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+22:3312:x1874694631355648:12345-0@lo:103: 00010000:00010000:1.0:1787848270.774422:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848270.774426:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb416 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb40f expref: 22 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774433:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb416 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb40f expref: 22 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774442:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848270.774462:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+22:3312:x1874694631355648:12345-0@lo:103: Request processed in 50us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.774469:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787848270.774481:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787848270.774486:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+21:3311:x1874694631355392:12345-0@lo:103: 00010000:00010000:1.0:1787848270.774493:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848270.774497:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff413a0800/0x9aeb41e0543cb44e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb447 expref: 21 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774504:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff413a0800/0x9aeb41e0543cb44e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb447 expref: 21 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774513:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848270.774546:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+21:3311:x1874694631355392:12345-0@lo:103: Request processed in 60us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.774552:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787848270.774565:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787848270.774571:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+20:3311:x1874694631355264:12345-0@lo:103: 00010000:00010000:1.0:1787848270.774578:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848270.774582:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff413a0600/0x9aeb41e0543cb45c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb455 expref: 20 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774589:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff413a0600/0x9aeb41e0543cb45c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb455 expref: 20 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774598:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848270.774619:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+20:3311:x1874694631355264:12345-0@lo:103: Request processed in 48us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.774625:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787848270.774636:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787848270.774664:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff50bb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631355776:12345-0@lo:103: 00010000:00010000:1.0:1787848270.774671:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848270.774675:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb3ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb3e5 expref: 19 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774682:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb3ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb3e5 expref: 19 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.774692:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848270.774714:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff50bb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631355776:12345-0@lo:103: Request processed in 51us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.774720:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787848270.774778:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631355264:0@lo:103: 00000100:00100000:1.0:1787848270.774787:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631355776:0@lo:103: 00000100:00100000:1.0:1787848270.774806:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631355392:0@lo:103: 00000100:00100000:1.0:1787848270.774834:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631355136:0@lo:103: 00000100:00100000:1.0:1787848270.774840:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631355648:0@lo:103: 00000100:00100000:1.0:1787848270.774845:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631355008:0@lo:103: 00000100:00100000:1.0:1787848270.774851:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631355520:0@lo:103: 00010000:00010000:3.0:1787848270.775369:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848270.777625:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff50664800/0x9aeb41e0543cb4a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb49b expref: 18 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.777725:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354112:0@lo:104: 00010000:00010000:2.0:1787848270.777857:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cb478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb471 expref: 17 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848270.777868:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354240:0@lo:104: 00010000:00010000:2.0:1787848270.777878:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff413a0600/0x9aeb41e0543cb45c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb455 expref: 16 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848270.777886:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354368:0@lo:104: 00010000:00010000:2.0:1787848270.777894:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff413a0800/0x9aeb41e0543cb44e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb447 expref: 15 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848270.777901:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354496:0@lo:104: 00010000:00010000:2.0:1787848270.777909:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff413a1a00/0x9aeb41e0543cb440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb439 expref: 14 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848270.777916:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354624:0@lo:104: 00010000:00010000:2.0:1787848270.777924:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb40f expref: 13 pid: 5837 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848270.777955:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354752:0@lo:104: 00010000:00010000:2.0:1787848270.777967:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c6000/0x9aeb41e0543cb3ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb3e5 expref: 12 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848270.777974:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631354880:0@lo:104: 00000100:00100000:2.0:1787848270.778932:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631353856:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848270.778943:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874694631353984:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848270.778981:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.785901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848270.785957:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611406976 00000100:00100000:1.0:1787848270.785965:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611406976 00010000:00010000:1.0:1787848270.785998:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff444c6e00/0x9aeb41e0543cb4b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0c2 expref: 10 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848270.786055:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:1.0:1787848270.786062:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2351:x1874694611406976:12345-192.168.201.26@tcp:103: 00010000:00010000:1.0:1787848270.786075:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848270.786079:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff444c6e00/0x9aeb41e0543cb4b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0c2 expref: 10 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.786088:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff444c6e00/0x9aeb41e0543cb4b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0c2 expref: 10 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.786103:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c6e00/0x9aeb41e0543cb4b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0c2 expref: 10 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.786114:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848270.786176:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:2351:x1874694611406976:12345-192.168.201.26@tcp:103: Request processed in 115us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848270.786182:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:2.0:1787848270.799633:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848270.799850:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611407104 00000100:00100000:0.0:1787848270.799863:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611407104 00010000:00010000:0.0:1787848270.799905:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff444c6c00/0x9aeb41e0543cb4b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0bb expref: 9 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848270.799940:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787848270.799948:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:2352:x1874694611407104:12345-192.168.201.26@tcp:103: 00010000:00010000:0.0:1787848270.799962:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848270.799966:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff444c6c00/0x9aeb41e0543cb4b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0bb expref: 9 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.799993:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff444c6c00/0x9aeb41e0543cb4b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0bb expref: 9 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.800008:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c6c00/0x9aeb41e0543cb4b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0bb expref: 9 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.800022:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.800029:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.800041:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.800045:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.800050:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.800054:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.800057:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848270.800060:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.800065:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.800088:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848270.800097:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848270.800150:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:2352:x1874694611407104:12345-192.168.201.26@tcp:103: Request processed in 202us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848270.800158:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00010000:00010000:2.0:1787848270.800227:0:8460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848270.800236:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848270.800241:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40031a00/0x9aeb41e0543cb4ef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848270.895912:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848271.045227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848271.045269:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848271.045363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848271.045402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848271.045453:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611407232 00000100:00100000:1.0:1787848271.045463:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611407232 00000100:00100000:1.0:1787848271.045517:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 133 00000100:00100000:1.0:1787848271.045527:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:2352:x1874694611407232:12345-192.168.201.26@tcp:400: 00000100:00100000:1.0:1787848271.045598:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:2352:x1874694611407232:12345-192.168.201.26@tcp:400: Request processed in 72us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848271.045608:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 133 00000100:00100000:3.0:1787848271.045983:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611407360 00000100:00100000:3.0:1787848271.045988:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611407360 00000100:00100000:3.0:1787848271.046043:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:3.0:1787848271.046051:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611407360:12345-192.168.201.26@tcp:400: 00000100:00100000:3.0:1787848271.046087:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611407360:12345-192.168.201.26@tcp:400: Request processed in 38us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848271.046094:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00080000:1.0:1787848271.046202:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848271.046581:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611407616 00000100:00100000:0.0:1787848271.046587:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611407616 00000100:00080000:1.0:1787848271.046916:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787848271.047024:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611407488 00000100:00100000:3.0:1787848271.047029:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611407488 00000100:00100000:3.0:1787848271.047095:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:3.0:1787848271.047103:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611407616:12345-192.168.201.26@tcp:400: 00000100:00100000:3.0:1787848271.047148:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611407616:12345-192.168.201.26@tcp:400: Request processed in 46us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848271.047155:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:3.0:1787848271.047170:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:3.0:1787848271.047177:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611407488:12345-192.168.201.26@tcp:400: 00000100:00100000:3.0:1787848271.047199:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611407488:12345-192.168.201.26@tcp:400: Request processed in 22us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848271.047205:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00080000:1.0:1787848271.047362:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787848271.919844:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787848272.176075:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787848272.176083:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93fe41342800 from 39 10000000:01000000:0.0:1787848272.176089:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787848272.176150:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848272.176163:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848272.176175:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848272.176200:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631355904:0@lo:101: 00000100:00100000:0.0:1787848272.176280:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848272.176361:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.176579:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631355904 00000100:00100000:3.0:1787848272.176587:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631355904 00000100:00100000:3.0:1787848272.176660:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787848272.176671:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+12:5839:x1874694631355904:12345-0@lo:101: 00010000:00010000:3.0:1787848272.176685:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848272.176699:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb4fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb4f6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.176722:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb4f6 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.176733:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb4f6 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.176743:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c7800, rc 0) 00000100:00100000:3.0:1787848272.176798:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631355904:12345-0@lo:101: Request processed in 129us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.176822:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787848272.177694:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631355904:0@lo:101: 00010000:00010000:0.0:1787848272.177712:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848272.177721:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848272.177805:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631356032:0@lo:501: 00000100:00100000:0.0:1787848272.177842:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848272.177892:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787848272.179901:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631356032 00000100:00100000:1.0:1787848272.179917:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631356032 00000100:00100000:1.0:1787848272.179991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787848272.180001:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631356032:12345-0@lo:501: 00000100:00100000:1.0:1787848272.181032:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631356032:12345-0@lo:501: Request processed in 1030us (3186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848272.181041:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787848272.181553:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631356032:0@lo:501: 00000100:00100000:0.0:1787848272.181604:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631356160:0@lo:503: 00000100:00100000:0.0:1787848272.182001:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848272.182113:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.197219:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631356160 00000100:00100000:3.0:1787848272.197301:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631356160 00000100:00100000:3.0:1787848272.197434:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787848272.197446:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631356160:12345-0@lo:503: 00000100:00100000:3.0:1787848272.198560:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631356160:12345-0@lo:503: Request processed in 1113us (16556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.198569:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787848272.217273:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631356160:0@lo:503: 00000100:00100000:3.0:1787848272.219058:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8477:1874694631356288:0@lo:502: 00000100:00100000:3.0:1787848272.219160:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848272.219207:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fd02d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848272.219718:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631356288 00000100:00100000:1.0:1787848272.219725:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631356288 00000100:00100000:1.0:1787848272.219786:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787848272.219797:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:8477:x1874694631356288:12345-0@lo:502: 00000100:00100000:1.0:1787848272.220070:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:8477:x1874694631356288:12345-0@lo:502: Request processed in 275us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848272.221554:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787848272.224377:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8477:1874694631356288:0@lo:502: 00000100:00100000:0.0:1787848272.224476:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8477:1874694631356416:0@lo:502: 00000100:00100000:0.0:1787848272.224551:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848272.224596:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.224707:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631356416 00000100:00100000:3.0:1787848272.224714:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631356416 00000100:00100000:3.0:1787848272.224782:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787848272.224792:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:8477:x1874694631356416:12345-0@lo:502: 00000100:00100000:3.0:1787848272.225038:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:8477:x1874694631356416:12345-0@lo:502: Request processed in 247us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.225046:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787848272.226214:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8477:1874694631356416:0@lo:502: 00000040:00080000:0.0:1787848272.226261:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787848272.226562:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787848272.226582:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787848272.226592:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.226618:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848272.226627:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787848272.226630:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787848272.226632:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787848272.226693:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.226702:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.226711:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848272.226728:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631356544:0@lo:101: 00000100:00100000:2.0:1787848272.226789:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848272.226828:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6a3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848272.228185:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631356544 00000100:00100000:1.0:1787848272.228193:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631356544 00000100:00100000:1.0:1787848272.228256:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787848272.228266:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+13:5839:x1874694631356544:12345-0@lo:101: 00010000:00010000:1.0:1787848272.228279:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848272.228293:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff414a4800/0x9aeb41e0543cb50b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb504 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.228318:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff414a4800/0x9aeb41e0543cb50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb504 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.228329:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff414a4800/0x9aeb41e0543cb50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb504 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.228338:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff414a4800, rc 0) 00000100:00100000:1.0:1787848272.228401:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631356544:12345-0@lo:101: Request processed in 136us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848272.228408:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787848272.228592:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631356544:0@lo:101: 00010000:00010000:2.0:1787848272.228607:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.228616:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848272.228692:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631356672:0@lo:501: 00000100:00100000:2.0:1787848272.228723:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848272.228784:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6a3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848272.228925:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631356672 00000100:00100000:1.0:1787848272.228930:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631356672 00000100:00100000:1.0:1787848272.228947:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787848272.228953:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631356672:12345-0@lo:501: 00000100:00100000:1.0:1787848272.229634:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631356672:12345-0@lo:501: Request processed in 679us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848272.229662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787848272.230852:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631356672:0@lo:501: 00000100:00100000:2.0:1787848272.230901:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631356800:0@lo:503: 00000100:00100000:2.0:1787848272.230961:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848272.231003:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6a3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.231063:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631356800 00000100:00100000:3.0:1787848272.231069:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631356800 00000100:00100000:3.0:1787848272.231122:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787848272.231132:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631356800:12345-0@lo:503: 00000100:00100000:3.0:1787848272.231321:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631356800:12345-0@lo:503: Request processed in 190us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.231342:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787848272.231784:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631356800:0@lo:503: 00000100:00100000:1.0:1787848272.233979:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8478:1874694631356928:0@lo:502: 00000100:00100000:1.0:1787848272.234063:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.234205:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787848272.250837:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631356928 00000100:00100000:0.0:1787848272.250853:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631356928 00000100:00100000:2.0:1787848272.251039:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787848272.251050:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:8478:x1874694631356928:12345-0@lo:502: 00000100:00100000:2.0:1787848272.251354:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:8478:x1874694631356928:12345-0@lo:502: Request processed in 306us (17290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848272.251363:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787848272.254269:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8478:1874694631356928:0@lo:502: 00000020:01000000:1.0:1787848272.254323:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787848272.254345:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848272.254348:0:8478:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787848272.254353:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787848272.254395:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8478:1874694631357056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848272.254485:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.254541:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff485a8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848272.254913:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631357056 00000100:00100000:2.0:1787848272.254920:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631357056 00000100:00100000:2.0:1787848272.254979:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787848272.254989:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:8478:x1874694631357056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848272.255212:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:8478:x1874694631357056:12345-0@lo:502:llog_process_th.0 Request processed in 225us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848272.255220:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787848272.255568:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8478:1874694631357056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787848272.255592:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787848272.255598:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848272.255599:0:8478:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787848272.255603:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787848272.256275:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787848272.256296:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787848272.256306:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.256317:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848272.256356:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787848272.256358:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ff4314e000 from 39 10000000:01000000:2.0:1787848272.256360:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787848272.256390:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.256398:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.256408:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848272.256427:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631357184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787848272.256482:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848272.256521:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6a3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.256700:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631357184 00000100:00100000:3.0:1787848272.256713:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631357184 00000100:00100000:3.0:1787848272.256758:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787848272.256777:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:5839:x1874694631357184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848272.256788:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848272.256801:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.256823:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb512 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.256833:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb512 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.256842:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c7600, rc 0) 00000100:00100000:3.0:1787848272.256884:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631357184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.256890:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787848272.257150:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631357184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848272.257165:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.257174:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848272.257219:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631357312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.257260:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.257281:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787848272.258366:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631357312 00000100:00100000:2.0:1787848272.258372:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631357312 00000100:00100000:2.0:1787848272.258415:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787848272.258424:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631357312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848272.258732:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631357312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848272.258739:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787848272.259019:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631357312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.259058:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631357440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.259115:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.259145:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787848272.259355:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631357440 00000100:00100000:2.0:1787848272.259359:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631357440 00000100:00100000:2.0:1787848272.259393:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787848272.259400:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631357440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848272.259893:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631357440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 493us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848272.259906:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787848272.273983:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631357440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.279466:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8479:1874694631357568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848272.279586:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.279630:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.279896:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631357568 00000100:00100000:3.0:1787848272.279903:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631357568 00000100:00100000:3.0:1787848272.279970:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787848272.279980:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:8479:x1874694631357568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787848272.280257:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:8479:x1874694631357568:12345-0@lo:502:llog_process_th.0 Request processed in 278us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.280265:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787848272.280613:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8479:1874694631357568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848272.280854:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8479:1874694631357696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848272.280893:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.280931:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787848272.280990:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631357696 00000100:00100000:2.0:1787848272.280996:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631357696 00000100:00100000:2.0:1787848272.281037:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787848272.281045:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:8479:x1874694631357696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848272.281219:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:8479:x1874694631357696:12345-0@lo:502:llog_process_th.0 Request processed in 175us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848272.281361:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8479:1874694631357696:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787848272.281381:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:2.0:1787848272.281706:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000020:01000000:2.0:1787848272.281741:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787848272.281762:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787848272.281781:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.281791:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848272.281800:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787848272.281802:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787848272.281805:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787848272.281829:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.281838:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.281848:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848272.281861:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb49e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631357824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787848272.281901:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848272.281912:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848272.282190:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631357824 00000100:00100000:2.0:1787848272.282195:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631357824 00000100:00100000:2.0:1787848272.282217:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787848272.282224:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:5839:x1874694631357824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848272.282337:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848272.282349:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cb527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb520 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.282371:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cb527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb520 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.282382:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cb527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb520 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.282390:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665c00, rc 0) 00000100:00100000:2.0:1787848272.282479:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631357824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848272.282486:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787848272.293128:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb49e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631357824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787848272.293159:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848272.293171:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848272.293337:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790ffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631357952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.293398:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.293437:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.293541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631357952 00000100:00100000:3.0:1787848272.293547:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631357952 00000100:00100000:3.0:1787848272.293599:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787848272.293608:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631357952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787848272.293906:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631357952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.293914:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787848272.294285:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790ffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631357952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.294317:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790ffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631358080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.294355:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.294376:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.296354:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631358080 00000100:00100000:3.0:1787848272.296366:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631358080 00000100:00100000:3.0:1787848272.296433:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787848272.296442:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631358080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787848272.296717:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631358080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.296725:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787848272.296970:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790ffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631358080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787848272.298442:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8480:1874694631358208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848272.298505:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848272.298548:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.298600:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631358208 00000100:00100000:3.0:1787848272.298607:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631358208 00000100:00100000:3.0:1787848272.298666:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787848272.298676:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:8480:x1874694631358208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787848272.298880:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:8480:x1874694631358208:12345-0@lo:502:llog_process_th.0 Request processed in 204us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.298888:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787848272.299280:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8480:1874694631358208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787848272.299306:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848272.299317:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848272.299319:0:8480:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787848272.299325:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787848272.299347:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8480:1874694631358336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848272.299381:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848272.299415:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.300046:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631358336 00000100:00100000:3.0:1787848272.300053:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631358336 00000100:00100000:3.0:1787848272.300090:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787848272.300098:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:8480:x1874694631358336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787848272.300269:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:8480:x1874694631358336:12345-0@lo:502:llog_process_th.0 Request processed in 170us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.300275:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787848272.300986:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8480:1874694631358336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787848272.301011:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848272.301018:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848272.301020:0:8480:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787848272.301026:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787848272.301305:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787848272.301324:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787848272.301348:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.301363:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848272.301388:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787848272.301391:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ff506b3000 from 39 10000000:01000000:1.0:1787848272.301394:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787848272.301421:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.301430:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.301439:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848272.301468:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790ffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631358464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.301512:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.301541:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.301829:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631358464 00000100:00100000:3.0:1787848272.301835:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631358464 00000100:00100000:3.0:1787848272.301879:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787848272.301889:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631358464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848272.301900:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848272.301913:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c7000/0x9aeb41e0543cb535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb52e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.301935:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c7000/0x9aeb41e0543cb535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb52e expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.301945:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c7000/0x9aeb41e0543cb535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb52e expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.302305:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c7000, rc 0) 00000100:00100000:3.0:1787848272.303536:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631358464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1644us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.303545:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787848272.304370:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790ffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631358464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848272.304395:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.304412:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848272.304559:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790ffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631358592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.304618:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.304677:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.306165:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631358592 00000100:00100000:3.0:1787848272.306178:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631358592 00000100:00100000:3.0:1787848272.306253:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787848272.306263:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631358592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787848272.306611:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631358592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.306619:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787848272.306906:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790ffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631358592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.306953:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790ffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631358720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.307007:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.307045:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787848272.308197:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631358720 00000100:00100000:0.0:1787848272.308205:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631358720 00000100:00100000:1.0:1787848272.308283:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787848272.308294:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631358720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.308543:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631358720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848272.308550:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787848272.308755:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790ffc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631358720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787848272.309316:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8481:1874694631358848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787848272.309376:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848272.309412:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813acd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848272.309469:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631358848 00000100:00100000:2.0:1787848272.309474:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631358848 00000100:00100000:2.0:1787848272.309508:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787848272.309516:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:8481:x1874694631358848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848272.309738:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:8481:x1874694631358848:12345-0@lo:502:llog_process_th.0 Request processed in 222us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848272.309754:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787848272.310168:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8481:1874694631358848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787848272.310215:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8481:1874694631358976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787848272.310261:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848272.310291:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848272.310350:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631358976 00000100:00100000:1.0:1787848272.310355:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631358976 00000100:00100000:1.0:1787848272.310388:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787848272.310396:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:8481:x1874694631358976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848272.310562:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:8481:x1874694631358976:12345-0@lo:502:llog_process_th.0 Request processed in 166us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848272.310580:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787848272.310750:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8481:1874694631358976:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787848272.310779:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787848272.311124:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787848272.311144:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787848272.311154:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.311165:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848272.311175:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787848272.311178:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787848272.311180:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787848272.311204:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.311233:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.311243:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848272.311258:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631359104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.311287:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.311319:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52db5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.311401:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631359104 00000100:00100000:3.0:1787848272.311406:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631359104 00000100:00100000:3.0:1787848272.311441:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787848272.311457:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631359104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848272.311467:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848272.311480:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c6a00/0x9aeb41e0543cb543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb53c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.311501:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c6a00/0x9aeb41e0543cb543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb53c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.311511:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c6a00/0x9aeb41e0543cb543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb53c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848272.311519:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c6a00, rc 0) 00000100:00100000:3.0:1787848272.311561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631359104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848272.311719:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631359104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848272.311733:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.311742:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848272.311798:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631359232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848272.311826:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848272.311846:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631359232 00000100:00100000:2.0:1787848272.311849:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631359232 00000100:00100000:3.0:1787848272.311957:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787848272.312823:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f692840 going to sleep for 11 seconds 00000100:00100000:2.0:1787848272.323168:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787848272.323200:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631359232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848272.323632:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631359232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 450us (11804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848272.323664:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787848272.324128:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631359232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787848272.324194:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631359360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787848272.324259:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848272.324293:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813ac300 going to sleep for 11 seconds 00000100:00100000:1.0:1787848272.324411:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631359360 00000100:00100000:1.0:1787848272.324418:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631359360 00000100:00100000:1.0:1787848272.324462:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787848272.324470:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631359360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.324693:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631359360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848272.324700:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787848272.324892:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631359360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848272.328934:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8482:1874694631359488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848272.329061:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848272.329111:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f692780 going to sleep for 11 seconds 00000100:00100000:1.0:1787848272.330078:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631359488 00000100:00100000:1.0:1787848272.330088:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631359488 00000100:00100000:1.0:1787848272.330169:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787848272.330180:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:8482:x1874694631359488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848272.330657:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:8482:x1874694631359488:12345-0@lo:502:llog_process_th.0 Request processed in 457us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848272.330667:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787848272.333001:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8482:1874694631359488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787848272.333105:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787848272.333135:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848272.333210:0:8482:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787848272.333227:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787848272.333551:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8482:1874694631359616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848272.334723:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848272.334805:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f692780 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.335374:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631359616 00000100:00100000:3.0:1787848272.335386:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631359616 00000100:00100000:3.0:1787848272.335466:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787848272.335476:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:8482:x1874694631359616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787848272.335832:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:8482:x1874694631359616:12345-0@lo:502:llog_process_th.0 Request processed in 355us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848272.335840:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787848272.336364:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8482:1874694631359616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787848272.336402:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848272.336411:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848272.336413:0:8482:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787848272.336419:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787848272.341541:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787848272.341584:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787848272.341597:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.341780:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848272.341795:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787848272.341798:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93ff520ab3a0 from 1 10000000:01000000:1.0:1787848272.341801:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787848272.341848:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb54a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.341857:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb54a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.341871:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb54a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848272.341901:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631359744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.341984:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.342030:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52db5900 going to sleep for 11 seconds 00000100:00100000:2.0:1787848272.345206:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631359744 00000100:00100000:2.0:1787848272.345222:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631359744 00000100:00100000:2.0:1787848272.345293:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787848272.345304:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631359744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848272.345325:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848272.345345:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50665400/0x9aeb41e0543cb551 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb54a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.345373:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50665400/0x9aeb41e0543cb551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb54a expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.345385:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50665400/0x9aeb41e0543cb551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb54a expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848272.345394:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665400, rc 0) 00000100:00100000:2.0:1787848272.345479:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631359744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (3494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848272.345486:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787848272.348205:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631359744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848272.348235:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb54a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb551 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.348247:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb54a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb551 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848272.348331:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631359872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848272.348390:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848272.348467:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52db5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787848272.348568:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631359872 00000100:00100000:3.0:1787848272.348575:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631359872 00000100:00100000:3.0:1787848272.348626:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787848272.348636:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631359872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787848272.348965:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631359872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 330us (574us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787848272.348974:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787848272.349325:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631359872:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787848272.349348:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787848272.349356:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb54a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb551 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.349364:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb54a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb551 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848272.946313:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848273.967903:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848274.438610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848274.438925:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611407744 00000100:00100000:3.0:1787848274.438936:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611407744 00000100:00100000:3.0:1787848274.438997:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00100000:3.0:1787848274.439007:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:5596:x1874694611407744:12345-192.168.201.26@tcp:101: 00010000:00010000:3.0:1787848274.439025:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848274.439054:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c7200/0x9aeb41e0543cb558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb124 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848274.439104:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c7200/0x9aeb41e0543cb558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb124 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848274.439126:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c7200/0x9aeb41e0543cb558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb124 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848274.439137:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c7200, rc 0) 00000100:00100000:3.0:1787848274.439201:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:5596:x1874694611407744:12345-192.168.201.26@tcp:101: Request processed in 195us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848274.439209:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00100000:1.0:1787848274.442452:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848274.442771:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611407872 00000100:00100000:2.0:1787848274.442781:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611407872 00000100:00100000:2.0:1787848274.442844:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 167 00000100:00100000:2.0:1787848274.442870:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:5596:x1874694611407872:12345-192.168.201.26@tcp:501: 00000100:00100000:2.0:1787848274.443333:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:5596:x1874694611407872:12345-192.168.201.26@tcp:501: Request processed in 456us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848274.443343:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 167 00000100:00100000:2.0:1787848274.456947:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848274.457887:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611408000 00000100:00100000:1.0:1787848274.457898:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611408000 00000100:00100000:1.0:1787848274.457963:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 168 00000100:00100000:1.0:1787848274.457974:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:5596:x1874694611408000:12345-192.168.201.26@tcp:503: 00000100:00100000:1.0:1787848274.458577:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:5596:x1874694611408000:12345-192.168.201.26@tcp:503: Request processed in 603us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848274.458586:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 168 00000100:00100000:1.0:1787848274.470626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848274.470762:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611408128 00000100:00100000:3.0:1787848274.470773:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611408128 00000100:00100000:3.0:1787848274.470846:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 169 00000100:00100000:3.0:1787848274.470856:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:6081:x1874694611408128:12345-192.168.201.26@tcp:502: 00000100:00100000:3.0:1787848274.471178:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:6081:x1874694611408128:12345-192.168.201.26@tcp:502: Request processed in 323us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848274.471186:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 169 00000100:00100000:2.0:1787848274.475098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848274.475277:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611408256 00000100:00100000:1.0:1787848274.475290:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611408256 00000100:00100000:1.0:1787848274.475393:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 170 00000100:00100000:1.0:1787848274.475406:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:6081:x1874694611408256:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787848274.475782:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:6081:x1874694611408256:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 378us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848274.475789:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 170 00000100:00100000:1.0:1787848274.480739:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848274.480834:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611408384 00000100:00100000:2.0:1787848274.480848:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611408384 00000100:00100000:2.0:1787848274.480919:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 171 00000100:00100000:2.0:1787848274.480929:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:5596:x1874694611408384:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848274.480947:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848274.480967:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50665600/0x9aeb41e0543cb55f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb12b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848274.481008:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50665600/0x9aeb41e0543cb55f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb12b expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848274.481020:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50665600/0x9aeb41e0543cb55f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb12b expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848274.481029:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665600, rc 0) 00000100:00100000:2.0:1787848274.481103:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5596:x1874694611408384:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 175us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848274.481110:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 171 00000100:00100000:2.0:1787848274.483261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848274.483365:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611408512 00000100:00100000:1.0:1787848274.483376:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611408512 00000100:00100000:1.0:1787848274.483442:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 172 00000100:00100000:1.0:1787848274.483450:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5596:x1874694611408512:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848274.483707:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5596:x1874694611408512:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 257us (460us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787848274.483716:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 172 00010000:00010000:1.0:1787848274.992619:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848275.312159:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631360128:0@lo:400:kworker.0 00000100:00100000:0.0:1787848275.312228:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848275.312298:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631360640:0@lo:400:kworker.0 00000100:00100000:0.0:1787848275.312323:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848275.312350:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787848275.312356:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631360256:0@lo:400:kworker.0 00000100:00100000:0.0:1787848275.312374:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848275.312472:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631360384:0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.312498:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848275.312523:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787848275.312528:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631360000:0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.312555:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848275.312574:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631360512:0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.312592:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848275.312619:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631360640 00000100:00100000:3.0:1787848275.312630:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631360640 00000100:00100000:3.0:1787848275.312705:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631360384 00000100:00100000:3.0:1787848275.312707:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631360384 00000100:00100000:3.0:1787848275.312745:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787848275.312756:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631360640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.312812:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631360640:12345-0@lo:400:kworker.0 Request processed in 59us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848275.312820:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787848275.312835:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787848275.312842:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631360384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.312880:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631360384:12345-0@lo:400:kworker.0 Request processed in 39us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848275.312885:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787848275.312903:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631360128 00000100:00100000:3.0:1787848275.312906:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631360128 00000100:00100000:3.0:1787848275.312930:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631360256 00000100:00100000:3.0:1787848275.312932:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631360256 00000100:00100000:3.0:1787848275.312942:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631360512 00000100:00100000:3.0:1787848275.312944:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631360512 00000100:00100000:3.0:1787848275.312954:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787848275.312959:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631360128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.312984:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631360128:12345-0@lo:400:kworker.0 Request processed in 25us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848275.312989:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787848275.312998:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787848275.313003:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631360256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.313027:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631360256:12345-0@lo:400:kworker.0 Request processed in 24us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848275.313042:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787848275.313054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787848275.313060:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631360512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.313087:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631360512:12345-0@lo:400:kworker.0 Request processed in 27us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848275.313092:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787848275.313110:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631360000 00000100:00100000:3.0:1787848275.313113:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631360000 00000100:00100000:3.0:1787848275.313137:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787848275.313143:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631360000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.313170:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631360000:12345-0@lo:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848275.313176:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1787848275.313211:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787848275.313216:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848275.313218:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787848275.313248:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631360000:0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.313262:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631360512:0@lo:400:kworker.0 00010000:00080000:3.0:1787848275.313273:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb4a940 x1874694631360384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848275.313283:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631360384:0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.313312:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631360256:0@lo:400:kworker.0 00000100:00100000:3.0:1787848275.313321:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631360128:0@lo:400:kworker.0 00010000:00080000:3.0:1787848275.313339:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0b0c0 x1874694631360640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848275.313347:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631360640:0@lo:400:kworker.0 00000100:00100000:1.0:1787848275.829323:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787848275.829349:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631360768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848275.829428:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848275.829849:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631360768 00000100:00100000:0.0:1787848275.829858:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631360768 00000100:00100000:0.0:1787848275.829903:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787848275.829914:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631360768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787848275.829951:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848275.830002:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631360768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848275.830009:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787848275.830049:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff790fc000 x1874694631360768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848275.830068:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631360768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848275.831260:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631360896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848275.831311:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848275.831371:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631360896 00000100:00100000:1.0:1787848275.831377:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631360896 00000100:00100000:1.0:1787848275.831409:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787848275.831415:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631360896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787848275.831443:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848275.831479:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631360896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848275.831485:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787848275.831517:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff790fcf00 x1874694631360896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848275.831531:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631360896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787848276.019849:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848276.168617:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848276.168691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848276.168733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848276.168760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848276.168786:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611408640 00000100:00100000:1.0:1787848276.168795:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611408640 00000100:00100000:1.0:1787848276.168838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 174 00000100:00100000:1.0:1787848276.168846:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2353:x1874694611408640:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848276.168910:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2353:x1874694611408640:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 65us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848276.168918:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 174 00000100:00100000:1.0:1787848276.168945:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611409024 00000100:00100000:1.0:1787848276.168948:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611409024 00000100:00100000:1.0:1787848276.168976:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611408896 00000100:00100000:1.0:1787848276.168978:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611408896 00000100:00100000:1.0:1787848276.168992:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:1.0:1787848276.168998:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2354:x1874694611409024:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848276.169022:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2354:x1874694611409024:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 24us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848276.169028:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:1.0:1787848276.169037:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:1.0:1787848276.169042:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611408896:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848276.169058:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611408896:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 17us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848276.169064:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00080000:1.0:1787848276.169182:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787848276.169186:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787848276.169325:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611408768 00000100:00100000:3.0:1787848276.169330:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611408768 00000100:00100000:3.0:1787848276.169371:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:3.0:1787848276.169377:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2354:x1874694611408768:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848276.169409:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2354:x1874694611408768:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 33us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848276.169415:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00080000:1.0:1787848276.169484:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1787848276.332176:0:8520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff91e715f0 20000000:00000080:3.0:1787848276.332197:0:8520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ff5f501400 uarg=0000000000000000 20000000:01000000:3.0:1787848276.332241:0:8520:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787848276.332247:0:8520:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787848276.332252:0:8520:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787848276.334552:0:8521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787848276.334632:0:8520:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787848276.338353:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787848276.338398:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787848276.338430:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787848276.338442:0:8520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787848276.338457:0:8520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848276.338472:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff413a1800/0x9aeb41e0543cb2db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb2d4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848276.338477:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff40030200/0x9aeb41e0543cb33d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb336 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848276.338481:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff414a5e00/0x9aeb41e0543cb408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb401 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848276.338487:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff444c7c00/0x9aeb41e0543cb4c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0f3 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848276.338501:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848276.338531:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff444c7c00/0x9aeb41e0543cb4c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0f3 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848276.338541:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff444c7c00/0x9aeb41e0543cb4c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0f3 expref: 9 pid: 5837 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848276.338553:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1874694631361024:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848276.338709:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff414a5e00/0x9aeb41e0543cb408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb401 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848276.338717:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff414a5e00/0x9aeb41e0543cb408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb401 expref: 18 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848276.338727:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1874694631361152:0@lo:104: 00000100:00100000:0.0:1787848276.338768:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787848276.338864:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff40030200/0x9aeb41e0543cb33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb336 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848276.338871:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff40030200/0x9aeb41e0543cb33d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb336 expref: 18 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848276.338879:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1874694631361280:0@lo:104: 00000100:00100000:0.0:1787848276.338902:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787848276.343940:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff413a1800/0x9aeb41e0543cb2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb2d4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848276.343981:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff413a1800/0x9aeb41e0543cb2db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb2d4 expref: 18 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848276.343999:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1874694631361408:0@lo:104: 00000100:00100000:0.0:1787848276.344040:0:8520:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787848276.344067:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1874694631361024:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848276.345075:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787848276.345113:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848276.345147:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631361152 00000100:00100000:3.0:1787848276.345553:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:3.0:1787848276.345559:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631361280 00000100:00100000:3.0:1787848276.345565:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631361280 00000100:00100000:3.0:1787848276.345899:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631361408 00000100:00100000:3.0:1787848276.345904:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631361408 00000100:00100000:3.0:1787848276.345924:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787848276.345932:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80746c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+4:8520:x1874694631361280:12345-0@lo:104: 00010000:00010000:3.0:1787848276.345948:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346059:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787848276.346065:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80746c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+4:8520:x1874694631361280:12345-0@lo:104: Request processed in 134us (7161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848276.346072:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787848276.346092:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787848276.346098:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:8520:x1874694631361408:12345-0@lo:104: 00010000:00010000:3.0:1787848276.346107:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff40030a00/0x9aeb41e0543cb2d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346142:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787848276.346148:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:8520:x1874694631361408:12345-0@lo:104: Request processed in 51us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848276.346166:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1787848276.346191:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787848276.346197:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346204:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a4a00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848276.346208:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346217:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848276.346223:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848276.346229:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787848276.346268:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346274:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787848276.346437:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1874694631361280:0@lo:104: 00000100:00100000:1.0:1787848276.346448:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1874694631361408:0@lo:104: 00010000:00010000:3.0:1787848276.346852:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346862:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb336 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb33d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346876:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848276.346880:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff40030a00/0x9aeb41e0543cb2d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346886:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030a00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848276.346889:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030a00/0x9aeb41e0543cb2d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346896:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff40030a00/0x9aeb41e0543cb2d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848276.346903:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030a00/0x9aeb41e0543cb2d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848276.346908:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787848276.346927:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff40030a00/0x9aeb41e0543cb2d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346933:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848276.346949:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff40030a00/0x9aeb41e0543cb2d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346967:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff40030a00/0x9aeb41e0543cb2d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb2db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.346977:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848276.346978:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848276.346980:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848276.346988:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848276.347097:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631361536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787848276.347146:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848276.347215:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631361664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787848276.347237:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848276.347270:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631361536 00000100:00100000:3.0:1787848276.347274:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631361536 00000100:00100000:1.0:1787848276.347390:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631361664 00000100:00100000:1.0:1787848276.347395:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631361664 00010000:00010000:3.0:1787848276.347538:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff40030200/0x9aeb41e0543cb33d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb336 expref: 20 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848276.347588:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631361152 00010000:00010000:1.0:1787848276.347782:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff413a1800/0x9aeb41e0543cb2db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb2d4 expref: 20 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848276.347825:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787848276.347836:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+20:3311:x1874694631361536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848276.347849:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848276.347856:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff40030200/0x9aeb41e0543cb33d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb336 expref: 20 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.347866:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff40030200/0x9aeb41e0543cb33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb336 expref: 20 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.347883:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40030200/0x9aeb41e0543cb33d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb336 expref: 20 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.347909:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848276.347950:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631361536:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848276.348121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848276.349538:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787848276.349554:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787848276.349844:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787848276.349867:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:8520:x1874694631361152:12345-0@lo:104: 00010000:00010000:2.0:1787848276.349885:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848276.349911:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611409152 00000100:00100000:1.0:1787848276.349917:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611409152 00010000:00010000:1.0:1787848276.349944:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff444c7c00/0x9aeb41e0543cb4c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0f3 expref: 10 pid: 5837 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848276.349961:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787848276.349963:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787848276.349968:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:8520:x1874694631361152:12345-0@lo:104: Request processed in 113us (11200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848276.349968:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787848276.349974:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787848276.349974:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631361664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787848276.349994:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848276.349999:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff413a1800/0x9aeb41e0543cb2db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb2d4 expref: 19 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848276.350118:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff413a1800/0x9aeb41e0543cb2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb2d4 expref: 19 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848276.350135:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff413a1800/0x9aeb41e0543cb2db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb2d4 expref: 19 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848276.350149:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848276.350192:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:3312:x1874694631361664:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (2954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848276.350214:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787848276.350227:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787848276.350234:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:1.0:1787848276.350241:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2351:x1874694611409152:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848276.350250:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848276.350255:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff444c7c00/0x9aeb41e0543cb4c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0f3 expref: 10 pid: 5837 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848276.350262:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631361664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787848276.350265:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff444c7c00/0x9aeb41e0543cb4c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0f3 expref: 10 pid: 5837 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848276.350275:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c7c00/0x9aeb41e0543cb4c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0f3 expref: 10 pid: 5837 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848276.350282:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848276.350337:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:2351:x1874694611409152:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 96us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848276.350344:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:1.0:1787848276.350484:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1874694631361152:0@lo:104: 00010000:00010000:1.0:1787848276.350508:0:8520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848276.351605:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787848276.351679:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631361536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848276.351774:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848276.351781:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.351790:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c7e00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848276.351795:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.351803:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848276.351811:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848276.351816:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787848276.351855:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.351862:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848276.351891:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.351899:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff444c7e00/0x9aeb41e0543cb401 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb408 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848276.351924:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631361792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848276.351927:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848276.351929:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848276.351930:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848276.351969:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848276.352140:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631361792 00000100:00100000:3.0:1787848276.352145:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631361792 00010000:00010000:3.0:1787848276.352169:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff414a5e00/0x9aeb41e0543cb408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb401 expref: 17 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848276.352197:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787848276.352206:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:3313:x1874694631361792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848276.352215:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848276.352220:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff414a5e00/0x9aeb41e0543cb408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb401 expref: 17 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352230:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff414a5e00/0x9aeb41e0543cb408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb401 expref: 17 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352243:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff414a5e00/0x9aeb41e0543cb408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb401 expref: 17 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352256:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352264:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352277:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352284:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352309:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352315:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352320:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030e00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848276.352323:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352331:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352348:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848276.352358:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787848276.352498:0:8520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848276.352506:0:8520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848276.352524:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40030e00/0x9aeb41e0543cb566 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848276.353861:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3313:x1874694631361792:12345-0@lo:103:ldlm_bl.0 Request processed in 1651us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848276.353872:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787848276.353972:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631361792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848277.039888:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787848277.743789:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787848277.743797:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93fe41342800 from 4 10000000:01000000:1.0:1787848277.743803:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787848277.743850:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.743871:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.743883:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848277.743909:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631361920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.743987:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848277.744049:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fbe1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787848277.744069:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631361920 00000100:00100000:3.0:1787848277.744212:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631361920 00000100:00100000:3.0:1787848277.744269:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787848277.744278:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631361920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848277.744291:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848277.744304:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c7e00/0x9aeb41e0543cb574 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb56d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848277.744339:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c7e00/0x9aeb41e0543cb574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb56d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848277.744348:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c7e00/0x9aeb41e0543cb574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb56d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848277.744356:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c7e00, rc 0) 00000100:00100000:3.0:1787848277.744407:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631361920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848277.744414:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787848277.744569:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631361920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787848277.744596:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848277.744605:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848277.744698:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631362048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848277.744728:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848277.744746:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787848277.744760:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631362048 00000100:00100000:0.0:1787848277.744764:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631362048 00000100:00100000:0.0:1787848277.744796:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787848277.744803:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631362048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848277.745068:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631362048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848277.745086:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787848277.745090:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631362048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787848277.745119:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631362176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787848277.745158:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848277.745183:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463a6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787848277.745238:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631362176 00000100:00100000:0.0:1787848277.745248:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631362176 00000100:00100000:0.0:1787848277.745280:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787848277.745286:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631362176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787848277.745420:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631362176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848277.745427:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787848277.745461:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631362176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787848277.745937:0:8561:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8561:1874694631362304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848277.745973:0:8561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848277.746043:0:8561:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52c71900 going to sleep for 11 seconds 00000100:00100000:3.0:1787848277.752894:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631362304 00000100:00100000:3.0:1787848277.752915:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631362304 00000100:00100000:1.0:1787848277.753491:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787848277.753507:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:8561:x1874694631362304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848277.753820:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:8561:x1874694631362304:12345-0@lo:502:llog_process_th.0 Request processed in 318us (7845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848277.753828:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787848277.755794:0:8561:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8561:1874694631362304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787848277.755853:0:8561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787848277.755944:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848277.755947:0:8561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787848277.755957:0:8561:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93fe41342800 00000020:00000080:1.0:1787848277.755959:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787848277.759481:0:8561:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8561:1874694631362432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848277.759575:0:8561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848277.759724:0:8561:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848277.759782:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631362432 00000100:00100000:2.0:1787848277.759791:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631362432 00000100:00100000:2.0:1787848277.759933:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787848277.759945:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:8561:x1874694631362432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848277.760160:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:8561:x1874694631362432:12345-0@lo:502:llog_process_th.0 Request processed in 216us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848277.760168:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787848277.760243:0:8561:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8561:1874694631362432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787848277.760272:0:8561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787848277.760280:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848277.760283:0:8561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787848277.760287:0:8561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787848277.760340:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787848277.760357:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787848277.760366:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.760375:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848277.760385:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787848277.760387:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff4314e000 from 4 10000000:01000000:1.0:1787848277.760390:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787848277.760411:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.760418:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.760426:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848277.760445:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631362560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.760471:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848277.760487:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848277.760500:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631362560 00000100:00100000:1.0:1787848277.760504:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631362560 00000100:00100000:1.0:1787848277.760527:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787848277.760533:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631362560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848277.760542:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848277.760553:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb582 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb57b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.760587:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb57b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.760598:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb57b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.760606:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff414a4600, rc 0) 00000100:00100000:1.0:1787848277.760633:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631362560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848277.760656:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787848277.760696:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631362560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848277.760708:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.760717:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848277.760762:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631362688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.760787:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848277.760807:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848277.760818:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631362688 00000100:00100000:1.0:1787848277.760821:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631362688 00000100:00100000:1.0:1787848277.760838:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787848277.760843:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631362688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.761062:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631362688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848277.761070:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787848277.761096:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631362688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.761119:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631362816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.761152:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848277.761164:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848277.761175:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631362816 00000100:00100000:1.0:1787848277.761178:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631362816 00000100:00100000:1.0:1787848277.761194:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787848277.761199:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631362816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.761308:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631362816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848277.761315:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787848277.771451:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631362816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787848277.781996:0:8565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8565:1874694631362944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848277.782082:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848277.782121:0:8565:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6ecee000 going to sleep for 11 seconds 00000100:00100000:1.0:1787848277.782398:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631362944 00000100:00100000:1.0:1787848277.782411:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631362944 00000100:00100000:1.0:1787848277.782451:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787848277.782460:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:8565:x1874694631362944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848277.782801:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:8565:x1874694631362944:12345-0@lo:502:llog_process_th.0 Request processed in 341us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848277.782810:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787848277.785009:0:8565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8565:1874694631362944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787848277.785055:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848277.785067:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848277.785070:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787848277.785076:0:8565:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ff4314e000 00000020:00000080:0.0:1787848277.785079:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787848277.785161:0:8565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8565:1874694631363072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848277.785223:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848277.785259:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631363072 00000100:00100000:0.0:1787848277.785265:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631363072 00000100:00100000:0.0:1787848277.785303:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787848277.785310:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:8565:x1874694631363072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848277.785488:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:8565:x1874694631363072:12345-0@lo:502:llog_process_th.0 Request processed in 177us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848277.785502:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787848277.785553:0:8565:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6ecee000 going to sleep for 11 seconds 00000100:00100000:0.0:1787848277.785565:0:8565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8565:1874694631363072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787848277.785947:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848277.785952:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848277.785954:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787848277.785958:0:8565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787848277.787898:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787848277.787926:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787848277.787937:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.787950:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848277.787960:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787848277.787962:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff506b3000 from 4 10000000:01000000:1.0:1787848277.787965:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787848277.787994:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.788003:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.788012:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848277.788033:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631363200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.788090:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848277.788121:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787848277.788139:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631363200 00000100:00100000:1.0:1787848277.788149:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631363200 00000100:00100000:1.0:1787848277.788188:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787848277.788196:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631363200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848277.788206:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848277.788228:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cb590 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb589 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.788251:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cb590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb589 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.788261:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cb590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb589 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.788270:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e400, rc 0) 00000100:00100000:1.0:1787848277.788308:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631363200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848277.788315:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787848277.788353:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631363200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848277.788365:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.788374:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848277.788416:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631363328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.788440:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848277.788454:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787848277.788465:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631363328 00000100:00100000:1.0:1787848277.788474:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631363328 00000100:00100000:1.0:1787848277.788494:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787848277.788500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631363328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.788753:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631363328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848277.788761:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787848277.788789:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631363328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.788815:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631363456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.788850:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848277.788868:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787848277.788878:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631363456 00000100:00100000:1.0:1787848277.788882:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631363456 00000100:00100000:1.0:1787848277.788902:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787848277.788908:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631363456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.789031:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631363456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848277.789038:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787848277.789076:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631363456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848277.798968:0:8568:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8568:1874694631363584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848277.799058:0:8568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848277.799098:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631363584 00000100:00100000:1.0:1787848277.799105:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631363584 00000100:00100000:1.0:1787848277.799145:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787848277.799154:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:8568:x1874694631363584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848277.799354:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:8568:x1874694631363584:12345-0@lo:502:llog_process_th.0 Request processed in 200us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848277.799368:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787848277.799421:0:8568:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787848277.799443:0:8568:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8568:1874694631363584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787848277.799473:0:8568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787848277.799482:0:8568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848277.799484:0:8568:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787848277.799491:0:8568:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ff506b3000 00000020:00000080:1.0:1787848277.799493:0:8568:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787848277.801042:0:8568:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8568:1874694631363712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848277.801100:0:8568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848277.801134:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631363712 00000100:00100000:1.0:1787848277.801139:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631363712 00000100:00100000:1.0:1787848277.801175:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787848277.801183:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:8568:x1874694631363712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848277.801347:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:8568:x1874694631363712:12345-0@lo:502:llog_process_th.0 Request processed in 164us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848277.801354:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787848277.801402:0:8568:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787848277.801420:0:8568:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:8568:1874694631363712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787848277.801443:0:8568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787848277.801450:0:8568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848277.801452:0:8568:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787848277.801456:0:8568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787848277.801513:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787848277.801534:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787848277.801544:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848277.801561:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848278.064828:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848278.148577:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848278.148630:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611409280 00000100:00100000:0.0:1787848278.148701:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611409280 00000100:00100000:0.0:1787848278.148787:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 190 00000100:00100000:0.0:1787848278.148796:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:5596:x1874694611409280:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787848278.148814:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848278.148832:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb597 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb132 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848278.148859:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb132 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848278.148868:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb132 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848278.148875:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40031c00, rc 0) 00000100:00100000:0.0:1787848278.148925:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5596:x1874694611409280:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 131us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848278.148933:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 190 00000100:00100000:3.0:1787848278.151832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848278.154748:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611409408 00000100:00100000:0.0:1787848278.154765:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611409408 00000100:00100000:0.0:1787848278.154861:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 191 00000100:00100000:0.0:1787848278.154873:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5596:x1874694611409408:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848278.155181:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5596:x1874694611409408:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 311us (3354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848278.155190:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 191 00000100:00100000:0.0:1787848278.157306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848278.157366:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611409536 00000100:00100000:2.0:1787848278.157373:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611409536 00000100:00100000:2.0:1787848278.157425:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 192 00000100:00100000:2.0:1787848278.157434:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5596:x1874694611409536:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848278.157624:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:5596:x1874694611409536:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 190us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848278.157631:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 192 00000100:00100000:3.0:1787848278.162504:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848278.162721:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611409664 00000100:00100000:0.0:1787848278.162733:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611409664 00000100:00100000:0.0:1787848278.162790:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 193 00000100:00100000:0.0:1787848278.162800:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:6145:x1874694611409664:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787848278.163015:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:6145:x1874694611409664:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 217us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848278.163024:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 193 00000100:00100000:3.0:1787848278.170898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848278.172710:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611409792 00000100:00100000:0.0:1787848278.172725:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611409792 00000100:00100000:0.0:1787848278.172790:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 194 00000100:00100000:0.0:1787848278.172801:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:6145:x1874694611409792:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787848278.173057:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:6145:x1874694611409792:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 257us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848278.173065:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 194 00010000:00010000:3.0:1787848279.088185:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848280.112835:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848280.440887:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631363840:0@lo:400:kworker.0 00000100:00100000:3.0:1787848280.440989:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848280.441108:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631363840 00000100:00100000:1.0:1787848280.441118:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631363840 00000100:00100000:1.0:1787848280.441198:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787848280.441209:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631363840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848280.441812:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631363968:0@lo:400:kworker.0 00000100:00100000:0.0:1787848280.441860:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848280.443682:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631363840:12345-0@lo:400:kworker.0 Request processed in 2459us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848280.443701:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787848280.444029:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631363840:0@lo:400:kworker.0 00000100:00100000:3.0:1787848280.444080:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631363968 00000100:00100000:3.0:1787848280.444088:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631363968 00000100:00100000:3.0:1787848280.444182:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787848280.444193:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631363968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848280.444284:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631363968:12345-0@lo:400:kworker.0 Request processed in 94us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848280.444292:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787848280.444344:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631363968:0@lo:400:kworker.0 00000100:00100000:3.0:1787848280.444616:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631364096:0@lo:400:kworker.0 00000100:00100000:1.0:1787848280.445875:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631364224:0@lo:400:kworker.0 00000100:00100000:1.0:1787848280.445969:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848280.446096:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631364480:0@lo:400:kworker.0 00000100:00100000:2.0:1787848280.446136:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848280.446169:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787848280.446175:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631364352:0@lo:400:kworker.0 00000100:00100000:2.0:1787848280.446202:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848280.446239:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631364224 00000100:00100000:2.0:1787848280.446249:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631364224 00000100:00100000:2.0:1787848280.446312:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631364480 00000100:00100000:2.0:1787848280.446315:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631364480 00000100:00100000:2.0:1787848280.446335:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787848280.446350:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631364224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848280.446471:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848280.446506:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631364352 00000100:00100000:3.0:1787848280.446510:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631364352 00000100:00100000:3.0:1787848280.446536:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631364096 00000100:00100000:3.0:1787848280.446539:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631364096 00000100:00100000:3.0:1787848280.446559:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787848280.446566:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631364352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848280.446602:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631364352:12345-0@lo:400:kworker.0 Request processed in 36us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848280.446610:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787848280.446676:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787848280.446683:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631364096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848280.446716:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631364096:12345-0@lo:400:kworker.0 Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848280.446723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787848280.446772:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631364096:0@lo:400:kworker.0 00000100:00100000:2.0:1787848280.450531:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631364224:12345-0@lo:400:kworker.0 Request processed in 4170us (4545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848280.450552:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787848280.450599:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787848280.450620:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631364480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848280.450738:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631364480:12345-0@lo:400:kworker.0 Request processed in 130us (4601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848280.450745:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787848280.450778:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787848280.450787:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787848280.450791:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848280.450862:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631364352:0@lo:400:kworker.0 00010000:00080000:2.0:1787848280.450893:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff804d0780 x1874694631364480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848280.450906:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631364480:0@lo:400:kworker.0 00010000:00080000:1.0:1787848280.464120:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff804d2d00 x1874694631364224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848280.464148:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631364224:0@lo:400:kworker.0 00000100:00100000:3.0:1787848280.943963:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631364608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848280.944065:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848280.944162:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848280.944169:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631364736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848280.944191:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848280.944235:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631364608 00000100:00100000:3.0:1787848280.944246:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631364608 00000100:00100000:3.0:1787848280.944294:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631364736 00000100:00100000:3.0:1787848280.944297:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631364736 00000100:00100000:3.0:1787848280.944315:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787848280.944340:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631364608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787848280.944391:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848280.944443:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631364608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848280.944450:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787848280.944494:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787848280.944502:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631364736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787848280.944525:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848280.944551:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631364736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848280.944557:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787848280.944598:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb70c0 x1874694631364736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848280.944631:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631364736:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787848280.944683:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb4b40 x1874694631364608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848280.944695:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631364608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787848281.140452:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848281.287840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848281.287937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848281.287971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848281.287999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848281.288039:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611410048 00000100:00100000:3.0:1787848281.288056:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611410048 00000100:00100000:3.0:1787848281.288151:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:3.0:1787848281.288165:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611410048:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848281.288267:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611410048:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 105us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848281.288276:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:1.0:1787848281.288682:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611409920 00000100:00100000:1.0:1787848281.288688:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611409920 00000100:00100000:1.0:1787848281.288733:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 196 00000100:00100000:1.0:1787848281.288742:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611409920:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848281.288787:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611409920:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 47us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848281.288794:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 196 00000100:00100000:2.0:1787848281.291877:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611410176 00000100:00100000:2.0:1787848281.291902:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611410176 00000100:00100000:2.0:1787848281.292016:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611410304 00000100:00100000:2.0:1787848281.292021:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611410304 00000100:00100000:2.0:1787848281.292055:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:2.0:1787848281.292075:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611410176:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848281.292207:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611410176:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 139us (4268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848281.292216:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:2.0:1787848281.292244:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:2.0:1787848281.292252:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611410304:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848281.292279:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611410304:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 29us (4279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848281.292286:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00080000:2.0:1787848281.292316:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787848281.292321:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787848281.292324:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787848282.160354:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848283.186366:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787848284.103686:0:8821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787848284.208168:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848285.232179:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848285.551948:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631364864:0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.552055:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848285.552136:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631365376:0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.552170:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848285.552207:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787848285.552213:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631364992:0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.552240:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848285.552261:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631365504:0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.552289:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848285.552321:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631365120:0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.552347:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848285.552369:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848285.552374:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631365248:0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.552397:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848285.552434:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631364864 00000100:00100000:2.0:1787848285.552443:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631364864 00000100:00100000:2.0:1787848285.552509:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787848285.552519:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631364864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.552606:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631364864:12345-0@lo:400:kworker.0 Request processed in 88us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848285.552613:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787848285.552687:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631365376 00000100:00100000:2.0:1787848285.552692:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631365376 00000100:00100000:2.0:1787848285.552733:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631364992 00000100:00100000:2.0:1787848285.552736:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631364992 00000100:00100000:2.0:1787848285.552748:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631365120 00000100:00100000:2.0:1787848285.552751:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631365120 00000100:00100000:2.0:1787848285.552767:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787848285.552773:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631365376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.552822:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631365376:12345-0@lo:400:kworker.0 Request processed in 49us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848285.552828:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787848285.552842:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787848285.552848:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631364992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.552876:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631364992:12345-0@lo:400:kworker.0 Request processed in 28us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848285.552882:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787848285.552895:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787848285.552901:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631365120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.552934:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631365120:12345-0@lo:400:kworker.0 Request processed in 33us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848285.552940:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787848285.552967:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631365504 00000100:00100000:2.0:1787848285.552970:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631365504 00000100:00100000:2.0:1787848285.553008:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631365248 00000100:00100000:2.0:1787848285.553011:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631365248 00000100:00100000:2.0:1787848285.553029:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787848285.553036:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631365504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.553069:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631365504:12345-0@lo:400:kworker.0 Request processed in 33us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848285.553075:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787848285.553091:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787848285.553098:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631365248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.553128:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631365248:12345-0@lo:400:kworker.0 Request processed in 32us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848285.553143:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787848285.553180:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787848285.553185:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787848285.553187:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787848285.553224:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff804d1a40 x1874694631365248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848285.553241:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631365248:0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.553255:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631365120:0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.553291:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631364992:0@lo:400:kworker.0 00010000:00080000:2.0:1787848285.553300:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff804d2940 x1874694631365504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848285.553309:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631365504:0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.553318:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631364864:0@lo:400:kworker.0 00000100:00100000:2.0:1787848285.553329:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631365376:0@lo:400:kworker.0 00000100:00100000:1.0:1787848286.064106:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787848286.064158:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631365632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848286.064276:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848286.064932:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631365760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848286.064968:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848286.065229:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631365632 00000100:00100000:3.0:1787848286.065249:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631365632 00000100:00100000:3.0:1787848286.065303:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631365760 00000100:00100000:3.0:1787848286.065307:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631365760 00000100:00100000:3.0:1787848286.065322:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787848286.065331:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631365632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787848286.065376:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848286.065436:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631365632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848286.065444:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787848286.065481:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787848286.065488:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631365760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787848286.065511:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1787848286.074119:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb2e1c0 x1874694631365632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848286.074161:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631365632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848286.080313:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631365760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14808us (15326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848286.080336:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787848286.081858:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb6940 x1874694631365760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848286.081895:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631365760:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787848286.255935:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848286.426535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848286.426588:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848286.426620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848286.426688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848286.426724:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611410688 00000100:00100000:3.0:1787848286.426737:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611410688 00000100:00100000:3.0:1787848286.426823:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611410816 00000100:00100000:3.0:1787848286.426827:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611410816 00000100:00100000:3.0:1787848286.426861:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:3.0:1787848286.426874:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2350:x1874694611410688:12345-192.168.201.26@tcp:9:kworker.0 00000020:00000080:3.0:1787848286.426920:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb4d3 00000100:00080000:3.0:1787848286.426932:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93ff4306b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787848286.426979:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787848286.427427:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+2:2350:x1874694611410688:12345-192.168.201.26@tcp:9:kworker.0 Request processed in 554us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848286.427436:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:3.0:1787848286.427457:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:3.0:1787848286.427465:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2350:x1874694611410816:12345-192.168.201.26@tcp:9:kworker.0 00000020:00000080:3.0:1787848286.427483:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb4da 00000100:00080000:3.0:1787848286.427489:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93ff43069000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787848286.427512:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787848286.427762:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+2:2350:x1874694611410816:12345-192.168.201.26@tcp:9:kworker.0 Request processed in 297us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848286.427770:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00080000:3.0:1787848286.427793:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848286.427798:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787848286.427812:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848286.427951:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848286.428598:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611410432 00000100:00100000:1.0:1787848286.428607:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611410432 00000100:00100000:1.0:1787848286.428686:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 198 00000100:00100000:1.0:1787848286.428696:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611410432:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848286.428746:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611410432:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 52us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848286.428753:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 198 00000100:00100000:2.0:1787848286.441258:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611410560 00000100:00100000:2.0:1787848286.441282:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611410560 00000100:00080000:0.0:1787848286.441580:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848286.441635:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:2.0:1787848286.441679:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611410560:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848286.441788:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611410560:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 118us (15198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848286.441797:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00000001:00100000:3.0:1787848287.205552:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00000020:00000080:3.0:1787848287.205568:0:6716:0:(genops.c:885:class_export_put()) final put ffff93ff43068800/8bb0bb0f-4511-40a8-bdfa-25f441891529 00000020:00000080:2.0:1787848287.210630:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff43068800/8bb0bb0f-4511-40a8-bdfa-25f441891529 for lustre-OST0000 00000020:00000080:2.0:1787848287.210745:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff4306b000 for lustre-OST0000 00010000:00010000:3.0:1787848287.280483:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848288.318715:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848289.333171:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787848289.782030:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00000020:00000080:0.0:1787848289.782061:0:7658:0:(genops.c:885:class_export_put()) final put ffff93ff43068000/8bb0bb0f-4511-40a8-bdfa-25f441891529 00000020:00000080:3.0:1787848289.782150:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff43068000/8bb0bb0f-4511-40a8-bdfa-25f441891529 for lustre-OST0001 00000020:00000080:3.0:1787848289.782216:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff43069000 for lustre-OST0001 00010000:00010000:2.0:1787848290.352063:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848290.672144:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787848290.684422:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631366016:0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.684535:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848290.684602:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631365888:0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.684636:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848290.684907:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631366016 00000100:00100000:3.0:1787848290.684917:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631366016 00000100:00100000:3.0:1787848290.684983:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787848290.684994:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631366016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848290.685057:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631366016:12345-0@lo:400:kworker.0 Request processed in 65us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848290.685065:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787848290.685932:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631366016:0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.685975:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631365888 00000100:00100000:1.0:1787848290.686000:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631365888 00000100:00100000:1.0:1787848290.686034:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787848290.686041:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631365888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.686099:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631365888:12345-0@lo:400:kworker.0 Request processed in 58us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848290.686106:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787848290.686143:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631365888:0@lo:400:kworker.0 00000100:00100000:0.0:1787848290.689352:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631366400:0@lo:400:kworker.0 00000100:00100000:0.0:1787848290.689473:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848290.689748:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631366272:0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.689798:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848290.689857:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787848290.689864:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631366144:0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.689907:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631366272 00000100:00100000:1.0:1787848290.689917:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631366272 00000100:00100000:1.0:1787848290.689989:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787848290.690000:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631366272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.690060:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631366272:12345-0@lo:400:kworker.0 Request processed in 62us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848290.690068:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787848290.690090:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787848290.690109:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631366528:0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.690133:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848290.690165:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631366528 00000100:00100000:1.0:1787848290.690168:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631366528 00000100:00100000:1.0:1787848290.690196:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787848290.690203:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631366528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.690237:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631366528:12345-0@lo:400:kworker.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848290.690259:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787848290.690274:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787848290.690301:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb6580 x1874694631366528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848290.690315:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631366528:0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.695805:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787848290.703761:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb7480 x1874694631366272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848290.703781:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631366272:0@lo:400:kworker.0 00000100:00100000:3.0:1787848290.709014:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631366400 00000100:00100000:1.0:1787848290.709014:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631366144 00000100:00100000:3.0:1787848290.709028:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631366400 00000100:00100000:1.0:1787848290.709028:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631366144 00000100:00080000:0.0:1787848290.709105:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848290.709113:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787848290.709124:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631366144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848290.709157:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787848290.709165:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631366400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.709257:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631366144:12345-0@lo:400:kworker.0 Request processed in 135us (13459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848290.709265:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787848290.709300:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631366400:12345-0@lo:400:kworker.0 Request processed in 136us (19827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848290.709306:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787848290.709359:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631366400:0@lo:400:kworker.0 00000100:00100000:1.0:1787848290.709368:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631366144:0@lo:400:kworker.0 00000100:00100000:1.0:1787848291.183830:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787848291.183868:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631366656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848291.183952:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848291.184040:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631366656 00000100:00100000:1.0:1787848291.184047:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631366656 00000100:00100000:1.0:1787848291.184090:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787848291.184100:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631366656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848291.184136:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848291.184194:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631366656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848291.184201:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787848291.184238:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff790fc000 x1874694631366656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848291.184257:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631366656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787848291.185163:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848291.185178:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631366784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848291.185224:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848291.185305:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631366784 00000100:00100000:3.0:1787848291.185311:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631366784 00000100:00100000:3.0:1787848291.185356:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787848291.185365:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631366784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787848291.185390:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848291.185452:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631366784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848291.185458:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787848291.185535:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff559b30c0 x1874694631366784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848291.185550:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631366784:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787848291.192221:0:9067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing yml_node 00010000:00010000:2.0:1787848291.377878:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848291.529122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848291.529170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848291.529200:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611411072 00000100:00100000:0.0:1787848291.529209:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611411072 00000100:00100000:0.0:1787848291.529274:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:0.0:1787848291.529285:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611411072:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848291.529356:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611411072:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848291.529364:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00080000:0.0:1787848291.529385:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848291.531293:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611410944 00000100:00100000:3.0:1787848291.531305:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611410944 00000100:00100000:3.0:1787848291.531375:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 200 00000100:00100000:3.0:1787848291.531385:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611410944:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848291.531457:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611410944:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 73us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848291.531465:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 200 00010000:00010000:1.0:1787848292.400675:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848293.423888:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848294.447899:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848295.485870:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848295.795576:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631367168:0@lo:400:kworker.0 00000100:00100000:2.0:1787848295.795679:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848295.795752:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848295.795758:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631367296:0@lo:400:kworker.0 00000100:00100000:2.0:1787848295.795782:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848295.795957:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631367040:0@lo:400:kworker.0 00000100:00100000:1.0:1787848295.795987:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848295.796012:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631367552:0@lo:400:kworker.0 00000100:00100000:1.0:1787848295.796029:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848295.796050:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787848295.796055:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631366912:0@lo:400:kworker.0 00000100:00100000:1.0:1787848295.796077:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848295.796094:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631367424:0@lo:400:kworker.0 00000100:00100000:1.0:1787848295.796124:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848295.796157:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631367296 00000100:00100000:1.0:1787848295.796164:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631367296 00000100:00100000:1.0:1787848295.796210:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631367552 00000100:00100000:1.0:1787848295.796213:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631367552 00000100:00100000:1.0:1787848295.796231:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787848295.796238:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631367296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848295.796280:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631367296:12345-0@lo:400:kworker.0 Request processed in 43us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848295.796287:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787848295.796319:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787848295.796325:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631367552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848295.796366:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631367552:12345-0@lo:400:kworker.0 Request processed in 42us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848295.796373:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787848295.796392:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631367168 00000100:00100000:1.0:1787848295.796395:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631367168 00000100:00100000:1.0:1787848295.796576:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631367040 00000100:00100000:1.0:1787848295.796579:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631367040 00000100:00100000:1.0:1787848295.796592:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631367424 00000100:00100000:1.0:1787848295.796594:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631367424 00000100:00100000:1.0:1787848295.796608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787848295.796613:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631367168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848295.797509:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787848295.797525:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631367040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848295.797617:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787848295.797625:0:5843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:00080000:2.0:1787848295.797690:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb7c00 x1874694631367296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848295.797707:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631367296:0@lo:400:kworker.0 00000100:00100000:2.0:1787848295.797721:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631367168:0@lo:400:kworker.0 00000100:00100000:2.0:1787848295.797896:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787848295.797904:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787848295.797914:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631367424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848295.799566:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631366912 00000100:00100000:3.0:1787848295.799576:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631366912 00000100:00100000:3.0:1787848295.799629:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787848295.799636:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631366912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848295.802588:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631367040:12345-0@lo:400:kworker.0 Request processed in 5060us (6590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848295.802602:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787848295.802997:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631367168:12345-0@lo:400:kworker.0 Request processed in 6379us (7314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848295.803005:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787848295.803055:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631367040:0@lo:400:kworker.0 00010000:00080000:1.0:1787848295.803071:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb7480 x1874694631367552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848295.803082:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631367552:0@lo:400:kworker.0 00000100:00080000:1.0:1787848295.803134:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787848295.803141:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848295.803144:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848295.808152:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631367424:12345-0@lo:400:kworker.0 Request processed in 10232us (12018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848295.808167:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787848295.816663:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631367424:0@lo:400:kworker.0 00000100:00100000:3.0:1787848295.821548:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631366912:12345-0@lo:400:kworker.0 Request processed in 21901us (25458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848295.821564:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787848295.821898:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631366912:0@lo:400:kworker.0 00000100:00100000:2.0:1787848296.304697:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631367680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787848296.304940:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848296.305191:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631367680 00000100:00100000:0.0:1787848296.305199:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631367680 00000100:00100000:0.0:1787848296.305252:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787848296.305262:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631367680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787848296.305297:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848296.305493:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631367680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 232us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848296.305515:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787848296.305968:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff790fe940 x1874694631367680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848296.305990:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631367680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787848296.306257:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848296.306269:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631367808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848296.306310:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848296.306583:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631367808 00000100:00100000:0.0:1787848296.306589:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631367808 00000100:00100000:3.0:1787848296.306905:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787848296.306917:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631367808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787848296.306946:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848296.307450:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631367808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 535us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848296.307457:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787848296.307870:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff790fe940 x1874694631367808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848296.307887:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631367808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787848296.495949:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848296.649788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848296.650056:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848296.650301:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611411328 00000100:00100000:1.0:1787848296.650309:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611411328 00000100:00100000:1.0:1787848296.650407:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:1.0:1787848296.650418:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611411328:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848296.650507:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611411328:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 92us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848296.650514:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00080000:2.0:1787848296.656783:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848296.657125:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611411200 00000100:00100000:0.0:1787848296.657137:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611411200 00000100:00100000:0.0:1787848296.657205:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 202 00000100:00100000:0.0:1787848296.657214:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611411200:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848296.657312:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611411200:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 99us (7544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848296.657321:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 202 00010000:00010000:1.0:1787848297.524681:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787848298.109757:0:9261:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.86 00010000:00010000:2.0:1787848298.555920:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848299.567868:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848300.591906:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848300.912030:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff8074b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631368320:0@lo:400:kworker.0 00000100:00100000:1.0:1787848300.912104:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848300.912172:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787848300.912179:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631368192:0@lo:400:kworker.0 00000100:00100000:1.0:1787848300.912240:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848300.912287:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631368320 00000100:00100000:1.0:1787848300.912294:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631368320 00000100:00100000:1.0:1787848300.912349:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787848300.912357:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631368320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848300.912720:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631368320:12345-0@lo:400:kworker.0 Request processed in 362us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848300.912728:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787848300.912753:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631368192 00000100:00100000:1.0:1787848300.912757:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631368192 00000100:00100000:1.0:1787848300.912785:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787848300.912792:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631368192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848300.912824:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631368192:12345-0@lo:400:kworker.0 Request processed in 33us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848300.912831:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787848300.912893:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631368192:0@lo:400:kworker.0 00010000:00080000:1.0:1787848300.912908:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff8074b480 x1874694631368320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848300.912918:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff8074b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631368320:0@lo:400:kworker.0 00000100:00100000:3.0:1787848300.913231:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff8074bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631367936:0@lo:400:kworker.0 00000100:00100000:3.0:1787848300.913284:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848300.913321:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631368448:0@lo:400:kworker.0 00000100:00100000:3.0:1787848300.913346:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848300.913373:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787848300.913379:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff8074a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631368064:0@lo:400:kworker.0 00000100:00100000:3.0:1787848300.913409:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848300.913437:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631368576:0@lo:400:kworker.0 00000100:00100000:3.0:1787848300.913458:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848300.913482:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631368448 00000100:00100000:3.0:1787848300.913485:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631368448 00000100:00100000:3.0:1787848300.913513:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631368064 00000100:00100000:3.0:1787848300.913516:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631368064 00000100:00100000:3.0:1787848300.913533:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787848300.913539:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631368448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848300.913575:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631368448:12345-0@lo:400:kworker.0 Request processed in 36us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848300.913581:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787848300.913603:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787848300.913609:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631368064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848300.913662:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631368064:12345-0@lo:400:kworker.0 Request processed in 29us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848300.913669:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787848300.913698:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff8074a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631368064:0@lo:400:kworker.0 00000100:00100000:3.0:1787848300.913707:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631368448:0@lo:400:kworker.0 00000100:00100000:0.0:1787848300.913948:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631367936 00000100:00100000:0.0:1787848300.913953:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631367936 00000100:00100000:0.0:1787848300.913988:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787848300.913996:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631367936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848300.914039:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631367936:12345-0@lo:400:kworker.0 Request processed in 44us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848300.914046:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787848300.914079:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff8074bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631367936:0@lo:400:kworker.0 00000100:00100000:1.0:1787848300.914939:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631368576 00000100:00100000:1.0:1787848300.914946:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631368576 00000100:00100000:1.0:1787848300.914989:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787848300.914998:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631368576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848300.915047:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631368576:12345-0@lo:400:kworker.0 Request processed in 51us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848300.915054:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787848300.915134:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787848300.915138:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787848300.915141:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787848300.916766:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff55bdf0c0 x1874694631368576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848300.916784:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631368576:0@lo:400:kworker.0 00000100:00100000:0.0:1787848301.429830:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848301.429857:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631368704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848301.429938:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848301.431779:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631368832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848301.431839:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848301.431955:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631368704 00000100:00100000:1.0:1787848301.431963:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631368704 00000100:00100000:1.0:1787848301.432002:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631368832 00000100:00100000:1.0:1787848301.432005:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631368832 00000100:00100000:1.0:1787848301.432020:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787848301.432028:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631368704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848301.432069:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848301.432127:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631368704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848301.432134:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787848301.432152:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787848301.432158:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631368832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787848301.432177:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848301.432202:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631368832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848301.432218:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787848301.432798:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff55bdf0c0 x1874694631368832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848301.432843:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631368832:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787848301.432861:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb6580 x1874694631368704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848301.432874:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631368704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787848301.617162:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848301.776578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848301.776676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848301.776764:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611411584 00000100:00100000:0.0:1787848301.776781:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611411584 00000100:00100000:0.0:1787848301.776845:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:0.0:1787848301.776855:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611411584:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848301.776939:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611411584:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 86us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848301.776947:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:2.0:1787848301.777058:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611411456 00000100:00100000:2.0:1787848301.777062:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611411456 00000100:00100000:2.0:1787848301.777098:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 204 00000100:00100000:2.0:1787848301.777105:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611411456:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848301.777132:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611411456:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848301.777139:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 204 00000100:00080000:3.0:1787848301.777580:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787848302.645519:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787848302.745441:0:9360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.86 00010000:00010000:1.0:1787848303.666296:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848304.687808:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848305.728427:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848306.032195:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631369216:0@lo:400:kworker.0 00000100:00100000:3.0:1787848306.032308:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848306.032390:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848306.032415:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631369344:0@lo:400:kworker.0 00000100:00100000:3.0:1787848306.032446:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848306.032493:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631369216 00000100:00100000:3.0:1787848306.032503:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631369216 00000100:00100000:3.0:1787848306.032577:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787848306.032590:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631369216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848306.032690:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631369216:12345-0@lo:400:kworker.0 Request processed in 104us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848306.032698:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787848306.032747:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848306.032802:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631369216:0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.033359:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631368960:0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.033418:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848306.033456:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631369472:0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.033484:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848306.033507:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787848306.033513:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631369088:0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.033533:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848306.033551:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631369600:0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.033573:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848306.033607:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631369344 00000100:00100000:1.0:1787848306.033613:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631369344 00000100:00100000:1.0:1787848306.033674:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631369600 00000100:00100000:1.0:1787848306.033677:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631369600 00000100:00100000:1.0:1787848306.033694:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787848306.033702:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631369344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.033755:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631369344:12345-0@lo:400:kworker.0 Request processed in 53us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848306.033762:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787848306.033777:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787848306.033783:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631369600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.033817:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631369600:12345-0@lo:400:kworker.0 Request processed in 35us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848306.033824:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787848306.033851:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631368960 00000100:00100000:1.0:1787848306.033856:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631368960 00000100:00100000:1.0:1787848306.033883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787848306.033889:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631368960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.033920:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631368960:12345-0@lo:400:kworker.0 Request processed in 31us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848306.033926:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787848306.033954:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631369472 00000100:00100000:1.0:1787848306.033958:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631369472 00000100:00100000:1.0:1787848306.033984:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631369088 00000100:00100000:1.0:1787848306.033987:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631369088 00000100:00100000:1.0:1787848306.034003:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787848306.034008:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631369472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.034037:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631369472:12345-0@lo:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848306.034044:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787848306.034055:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787848306.034060:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631369088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.034085:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631369088:12345-0@lo:400:kworker.0 Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848306.034091:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787848306.034126:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787848306.034130:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848306.034133:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787848306.034160:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631369088:0@lo:400:kworker.0 00010000:00080000:1.0:1787848306.034174:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e12c0 x1874694631369600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848306.034209:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631369600:0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.034221:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631368960:0@lo:400:kworker.0 00000100:00100000:1.0:1787848306.034574:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631369472:0@lo:400:kworker.0 00010000:00080000:1.0:1787848306.034624:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5317e940 x1874694631369344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848306.034637:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631369344:0@lo:400:kworker.0 00000100:00100000:2.0:1787848306.544897:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631369728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848306.545017:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848306.545125:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631369728 00000100:00100000:2.0:1787848306.545136:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631369728 00000100:00100000:2.0:1787848306.545228:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787848306.545240:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631369728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848306.545289:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848306.545352:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631369728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848306.545360:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787848306.545416:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff804d1680 x1874694631369728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848306.545438:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631369728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848306.546554:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787848306.546574:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631369856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848306.546663:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848306.546741:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631369856 00000100:00100000:3.0:1787848306.546751:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631369856 00000100:00100000:3.0:1787848306.546805:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787848306.546815:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631369856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787848306.546860:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848306.546932:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631369856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848306.546954:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787848306.547513:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb70c0 x1874694631369856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848306.547534:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631369856:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787848306.651963:0:9458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.86 00010000:00010000:0.0:1787848306.736601:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848306.904333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848306.904397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848306.904437:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611411840 00000100:00100000:0.0:1787848306.904451:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611411840 00000100:00100000:0.0:1787848306.904532:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:0.0:1787848306.904546:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611411840:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848306.904671:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611411840:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 127us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848306.904679:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:0.0:1787848306.904711:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611411712 00000100:00100000:0.0:1787848306.904724:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611411712 00000100:00100000:0.0:1787848306.904751:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 206 00000100:00100000:0.0:1787848306.904758:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2351:x1874694611411712:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848306.904787:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2351:x1874694611411712:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848306.904794:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 206 00000100:00080000:1.0:1787848306.905920:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787848307.761284:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848308.789549:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787848309.102965:0:9506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 12:31:47 EDT 2026 00010000:00010000:1.0:1787848309.814045:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848310.832635:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848311.153061:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff8074b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631370112:0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.153168:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848311.153232:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631370624:0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.153273:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848311.153310:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787848311.153316:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631369984:0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.153347:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848311.153367:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631370496:0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.153388:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848311.153414:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff8074a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631370240:0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.153437:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848311.153455:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787848311.153461:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631370368:0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.153500:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848311.153535:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631370112 00000100:00100000:1.0:1787848311.153543:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631370112 00000100:00100000:1.0:1787848311.153594:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631370496 00000100:00100000:1.0:1787848311.153597:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631370496 00000100:00100000:1.0:1787848311.153622:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631370240 00000100:00100000:1.0:1787848311.153624:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631370240 00000100:00100000:1.0:1787848311.153683:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787848311.153694:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631370112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.153754:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631370112:12345-0@lo:400:kworker.0 Request processed in 62us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848311.153762:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787848311.153779:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787848311.153785:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631370496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.153812:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631370496:12345-0@lo:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848311.153818:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787848311.153828:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787848311.153833:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631370240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.153864:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631370240:12345-0@lo:400:kworker.0 Request processed in 30us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848311.153870:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787848311.153890:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631370624 00000100:00100000:1.0:1787848311.153893:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631370624 00000100:00100000:1.0:1787848311.153918:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631370368 00000100:00100000:1.0:1787848311.153921:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631370368 00000100:00100000:1.0:1787848311.153936:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787848311.153942:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631370624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.153981:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631370624:12345-0@lo:400:kworker.0 Request processed in 39us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848311.153988:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787848311.154000:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787848311.154005:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631370368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.154030:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631370368:12345-0@lo:400:kworker.0 Request processed in 25us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848311.154036:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787848311.154056:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631369984 00000100:00100000:1.0:1787848311.154059:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631369984 00000100:00100000:1.0:1787848311.154098:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787848311.154111:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631369984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.154139:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631369984:12345-0@lo:400:kworker.0 Request processed in 35us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848311.154145:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:1.0:1787848311.154192:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787848311.154196:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848311.154198:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787848311.154252:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb49a40 x1874694631370368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848311.154269:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631370368:0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.154282:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff8074a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631370240:0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.154316:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631369984:0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.154327:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631370496:0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.154349:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff8074b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631370112:0@lo:400:kworker.0 00010000:00080000:1.0:1787848311.154360:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff55ae5680 x1874694631370624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848311.154369:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631370624:0@lo:400:kworker.0 00000100:00100000:1.0:1787848311.670884:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787848311.670907:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631370752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848311.670970:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848311.675116:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631370752 00000100:00100000:3.0:1787848311.675129:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631370752 00000100:00100000:3.0:1787848311.675292:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787848311.675302:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631370752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787848311.675343:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848311.675593:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631370880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848311.683613:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848311.683820:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631370752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8517us (12846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848311.683832:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787848311.683856:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631370880 00000100:00100000:3.0:1787848311.683863:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631370880 00000100:00100000:3.0:1787848311.683892:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787848311.683899:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631370880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787848311.683934:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848311.683966:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631370880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848311.683972:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787848311.684128:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff55ae5680 x1874694631370880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848311.684148:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631370880:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787848311.684160:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff805c7480 x1874694631370752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848311.684173:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631370752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787848311.855818:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848312.015126:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848312.015179:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848312.015293:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611412096 00000100:00100000:1.0:1787848312.015303:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611412096 00000100:00100000:1.0:1787848312.015382:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:1.0:1787848312.015393:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2354:x1874694611412096:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848312.015468:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2354:x1874694611412096:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 77us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848312.015477:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:1.0:1787848312.015510:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611411968 00000100:00100000:1.0:1787848312.015514:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611411968 00000100:00100000:1.0:1787848312.015540:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 208 00000100:00100000:1.0:1787848312.015548:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2354:x1874694611411968:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848312.015586:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2354:x1874694611411968:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848312.015594:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 208 00000100:00080000:0.0:1787848312.015844:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787848312.887991:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848313.903929:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848314.929449:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848315.962990:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848316.271964:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631371008:0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.272058:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848316.272115:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631371520:0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.272143:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848316.272172:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787848316.272178:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631371136:0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.272200:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848316.272216:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631371648:0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.272239:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848316.272286:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631371392:0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.272309:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848316.272327:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787848316.272333:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631371264:0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.272353:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848316.272382:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631371520 00000100:00100000:1.0:1787848316.272390:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631371520 00000100:00100000:3.0:1787848316.272578:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631371008 00000100:00100000:3.0:1787848316.272583:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631371008 00000100:00100000:3.0:1787848316.272627:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787848316.272636:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631371008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848316.272706:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631371008:12345-0@lo:400:kworker.0 Request processed in 72us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848316.272714:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787848316.272825:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631371136 00000100:00100000:1.0:1787848316.272829:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631371136 00000100:00100000:1.0:1787848316.272850:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631371264 00000100:00100000:1.0:1787848316.272853:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631371264 00000100:00100000:1.0:1787848316.272870:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787848316.272876:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631371520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.272908:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631371520:12345-0@lo:400:kworker.0 Request processed in 33us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848316.272915:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787848316.272927:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787848316.272933:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631371136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.272958:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631371136:12345-0@lo:400:kworker.0 Request processed in 26us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848316.272965:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787848316.272977:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787848316.272983:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80749680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631371264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.273025:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80749680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631371264:12345-0@lo:400:kworker.0 Request processed in 43us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848316.273032:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787848316.273055:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631371648 00000100:00100000:1.0:1787848316.273059:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631371648 00000100:00100000:1.0:1787848316.273082:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631371392 00000100:00100000:1.0:1787848316.273085:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631371392 00000100:00100000:1.0:1787848316.273100:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787848316.273105:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631371648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.273131:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631371648:12345-0@lo:400:kworker.0 Request processed in 27us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848316.273145:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787848316.273157:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787848316.273162:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631371392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.273187:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631371392:12345-0@lo:400:kworker.0 Request processed in 25us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848316.273192:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787848316.273216:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787848316.273220:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848316.273222:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848316.273413:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631371136:0@lo:400:kworker.0 00010000:00080000:0.0:1787848316.273427:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e21c0 x1874694631371648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848316.273436:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631371648:0@lo:400:kworker.0 00000100:00100000:0.0:1787848316.273445:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631371008:0@lo:400:kworker.0 00000100:00100000:0.0:1787848316.273453:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631371520:0@lo:400:kworker.0 00000100:00100000:1.0:1787848316.273544:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631371264:0@lo:400:kworker.0 00010000:00080000:1.0:1787848316.273559:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e3480 x1874694631371392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848316.273568:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631371392:0@lo:400:kworker.0 00000100:00100000:3.0:1787848316.785472:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631371776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848316.785545:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848316.785629:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631371776 00000100:00100000:3.0:1787848316.785669:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631371776 00000100:00100000:3.0:1787848316.785713:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787848316.785721:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631371776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787848316.785756:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848316.785799:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631371776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848316.785807:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787848316.785873:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e1680 x1874694631371776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848316.785891:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631371776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848316.788670:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631371904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848316.788762:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848316.788828:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631371904 00000100:00100000:0.0:1787848316.788834:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631371904 00000100:00100000:0.0:1787848316.788888:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787848316.788903:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631371904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787848316.789098:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848316.789245:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631371904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 308us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848316.789257:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787848316.791412:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb7480 x1874694631371904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848316.791443:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631371904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787848316.975857:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848317.140505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848317.140560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848317.140700:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611412224 00000100:00100000:2.0:1787848317.140710:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611412224 00000100:00100000:2.0:1787848317.140773:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 210 00000100:00100000:2.0:1787848317.140783:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611412224:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848317.140861:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2352:x1874694611412224:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 79us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848317.140870:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 210 00000100:00100000:3.0:1787848317.141117:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611412352 00000100:00100000:3.0:1787848317.141122:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611412352 00000100:00100000:3.0:1787848317.141181:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:3.0:1787848317.141190:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611412352:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848317.141228:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611412352:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 40us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848317.141236:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00080000:0.0:1787848317.141302:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787848318.003015:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848319.024383:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848320.049142:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848321.074902:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848321.393300:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631372032:0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.393373:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848321.393421:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7929b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631372544:0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.393447:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848321.393473:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787848321.393479:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631372160:0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.393500:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848321.393519:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79298780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631372672:0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.393540:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848321.393568:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631372288:0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.393587:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848321.393606:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787848321.393611:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631372416:0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.393631:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848321.393682:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631372032 00000100:00100000:0.0:1787848321.393688:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631372032 00000100:00100000:0.0:1787848321.393733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787848321.393740:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631372032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.393793:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631372032:12345-0@lo:400:kworker.0 Request processed in 54us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848321.393800:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787848321.393828:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631372544 00000100:00100000:0.0:1787848321.393832:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631372544 00000100:00100000:0.0:1787848321.393860:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631372160 00000100:00100000:0.0:1787848321.393862:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631372160 00000100:00100000:0.0:1787848321.393877:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631372288 00000100:00100000:0.0:1787848321.393879:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631372288 00000100:00100000:0.0:1787848321.393891:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787848321.393897:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631372544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.393937:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631372544:12345-0@lo:400:kworker.0 Request processed in 41us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848321.393943:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787848321.393954:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787848321.393960:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631372160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.393986:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631372160:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848321.393992:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787848321.394002:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787848321.394007:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79299a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631372288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.394036:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79299a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631372288:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848321.394042:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787848321.394062:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631372672 00000100:00100000:0.0:1787848321.394065:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631372672 00000100:00100000:0.0:1787848321.394088:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631372416 00000100:00100000:0.0:1787848321.394098:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631372416 00000100:00100000:0.0:1787848321.394115:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787848321.394121:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79299e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631372672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.394149:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79299e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631372672:12345-0@lo:400:kworker.0 Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848321.394154:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787848321.394164:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787848321.394169:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631372416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.394190:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631372416:12345-0@lo:400:kworker.0 Request processed in 22us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848321.394195:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787848321.394218:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787848321.394222:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787848321.394224:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787848321.394255:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb4000 x1874694631372416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848321.394268:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631372416:0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.394280:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631372288:0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.394309:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631372160:0@lo:400:kworker.0 00010000:00080000:0.0:1787848321.394318:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff79298780 x1874694631372672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848321.394326:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79298780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631372672:0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.394333:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631372032:0@lo:400:kworker.0 00000100:00100000:0.0:1787848321.394341:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7929b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631372544:0@lo:400:kworker.0 00000100:00100000:2.0:1787848321.903863:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787848321.903887:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631372800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848321.903973:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848321.904265:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631372800 00000100:00100000:3.0:1787848321.904273:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631372800 00000100:00100000:3.0:1787848321.904340:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787848321.904351:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631372800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787848321.904393:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848321.904443:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631372800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848321.904450:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787848321.904498:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e1680 x1874694631372800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848321.904513:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631372800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848321.904854:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787848321.904865:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631372928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848321.904911:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848321.914754:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631372928 00000100:00100000:2.0:1787848321.914771:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631372928 00000100:00100000:3.0:1787848321.914944:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787848321.914956:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631372928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787848321.914995:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848321.915094:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631372928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (10192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848321.915102:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787848321.915186:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff804d1680 x1874694631372928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848321.915208:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631372928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787848322.096531:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848322.242473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848322.242601:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611412608 00000100:00100000:0.0:1787848322.242610:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611412608 00000100:00100000:0.0:1787848322.242707:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00100000:0.0:1787848322.242718:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611412608:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848322.242791:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611412608:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 75us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848322.242798:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00080000:3.0:1787848322.243190:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848322.243304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848322.243394:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611412480 00000100:00100000:3.0:1787848322.243399:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611412480 00000100:00100000:3.0:1787848322.243435:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 212 00000100:00100000:3.0:1787848322.243443:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2351:x1874694611412480:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848322.243476:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2351:x1874694611412480:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 34us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848322.243483:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 212 00010000:00010000:1.0:1787848323.120439:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848324.147598:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848325.167928:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848326.197380:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848326.514307:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631373184:0@lo:400:kworker.0 00000100:00100000:3.0:1787848326.514369:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631373312:0@lo:400:kworker.0 00000100:00100000:0.0:1787848326.514447:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631373056:0@lo:400:kworker.0 00000100:00100000:3.0:1787848326.522557:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848326.522696:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848326.522716:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631373440:0@lo:400:kworker.0 00000100:00100000:3.0:1787848326.522781:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848326.523118:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631373312 00000100:00100000:1.0:1787848326.523130:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631373312 00000100:00100000:1.0:1787848326.523221:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787848326.523236:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631373312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848326.523344:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631373312:12345-0@lo:400:kworker.0 Request processed in 113us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848326.523352:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787848326.523559:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631373440 00000100:00100000:1.0:1787848326.523565:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631373440 00000100:00100000:1.0:1787848326.523604:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787848326.523612:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631373440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848326.523682:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631373440:12345-0@lo:400:kworker.0 Request processed in 71us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848326.523689:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787848326.523770:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848326.523776:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787848326.523812:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7956c3c0 x1874694631373440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848326.523840:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631373440:0@lo:400:kworker.0 00000100:00100000:3.0:1787848326.523856:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631373312:0@lo:400:kworker.0 00000100:00100000:0.0:1787848326.525859:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848326.525930:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631373056 00000100:00100000:1.0:1787848326.525942:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631373056 00000100:00100000:0.0:1787848326.525947:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631373568:0@lo:400:kworker.0 00000100:00100000:0.0:1787848326.526005:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848326.526020:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787848326.526031:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631373056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848326.526033:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631373568 00000100:00100000:0.0:1787848326.526037:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631373568 00000100:00100000:0.0:1787848326.526080:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787848326.526087:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631373568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848326.526095:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631373056:12345-0@lo:400:kworker.0 Request processed in 66us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848326.526102:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787848326.526117:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631373568:12345-0@lo:400:kworker.0 Request processed in 32us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848326.526123:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787848326.526176:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631373568:0@lo:400:kworker.0 00000100:00100000:1.0:1787848326.526212:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631373056:0@lo:400:kworker.0 00000100:00080000:3.0:1787848326.526375:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848326.530630:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848326.530736:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631373696:0@lo:400:kworker.0 00000100:00100000:2.0:1787848326.530817:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848326.531003:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631373696 00000100:00100000:1.0:1787848326.531014:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631373696 00000100:00100000:1.0:1787848326.531109:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787848326.531122:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631373696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848326.531192:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631373696:12345-0@lo:400:kworker.0 Request processed in 74us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848326.531215:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631373184 00000100:00100000:0.0:1787848326.531220:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631373184 00000100:00100000:1.0:1787848326.531223:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787848326.531256:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787848326.531264:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631373184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848326.531306:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631373184:12345-0@lo:400:kworker.0 Request processed in 44us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848326.531313:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787848326.531395:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787848326.531905:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631373184:0@lo:400:kworker.0 00010000:00080000:2.0:1787848326.531921:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7956f480 x1874694631373696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848326.531932:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631373696:0@lo:400:kworker.0 00000100:00100000:0.0:1787848327.024000:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848327.024036:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631373824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848327.024139:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848327.024257:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631373824 00000100:00100000:2.0:1787848327.024268:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631373824 00000100:00100000:2.0:1787848327.024350:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787848327.024363:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79298b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631373824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848327.024412:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848327.024488:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79298b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631373824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848327.024497:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787848327.024547:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb49a40 x1874694631373824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848327.024570:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631373824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848327.024948:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848327.024962:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631373952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848327.025003:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848327.025104:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631373952 00000100:00100000:2.0:1787848327.025109:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631373952 00000100:00100000:2.0:1787848327.025143:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787848327.025150:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631373952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848327.025177:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848327.025223:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631373952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848327.025230:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787848327.025316:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb49a40 x1874694631373952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848327.025345:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631373952:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787848327.217689:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848327.368618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848327.368722:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848327.368893:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611412736 00000100:00100000:1.0:1787848327.368906:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611412736 00000100:00100000:1.0:1787848327.368970:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 214 00000100:00100000:1.0:1787848327.368982:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2353:x1874694611412736:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848327.369075:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2353:x1874694611412736:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 95us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848327.369083:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 214 00000100:00100000:3.0:1787848327.369671:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611412864 00000100:00100000:3.0:1787848327.369678:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611412864 00000100:00100000:3.0:1787848327.369752:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 76 00000100:00100000:3.0:1787848327.369763:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611412864:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848327.369833:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611412864:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 73us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848327.369841:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 76 00000100:00080000:0.0:1787848327.370077:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787848327.610315:0:10136:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:32:05 (1787848325) === 00010000:00010000:3.0:1787848328.240001:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848328.319282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848328.322136:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611412992 00000100:00100000:3.0:1787848328.322159:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611412992 00000100:00100000:3.0:1787848328.322270:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 215 00000100:00100000:3.0:1787848328.322283:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:8142:x1874694611412992:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787848328.322339:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848328.322368:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c6200/0x9aeb41e0543cb59e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb139 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848328.322421:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c6200/0x9aeb41e0543cb59e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb139 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848328.322434:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c6200/0x9aeb41e0543cb59e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb139 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848328.322443:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c6200, rc 0) 00000100:00100000:3.0:1787848328.322545:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:8142:x1874694611412992:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 264us (3279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848328.322553:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 215 00000100:00100000:3.0:1787848328.336122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848328.336430:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611413120 00000100:00100000:0.0:1787848328.336446:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611413120 00000100:00100000:0.0:1787848328.336572:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 216 00000100:00100000:0.0:1787848328.336587:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:8142:x1874694611413120:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787848328.338398:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:8142:x1874694611413120:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 1800us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848328.340187:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 216 00000100:00100000:2.0:1787848328.372859:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848328.373220:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611413248 00000100:00100000:0.0:1787848328.373234:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611413248 00000100:00100000:0.0:1787848328.373301:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 217 00000100:00100000:0.0:1787848328.373311:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:8142:x1874694611413248:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787848328.378980:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:8142:x1874694611413248:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 5649us (6119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848328.379035:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 217 00000100:00100000:2.0:1787848328.392876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848328.393801:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611413376 00000100:00100000:0.0:1787848328.393813:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611413376 00000100:00100000:0.0:1787848328.394137:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 218 00000100:00100000:0.0:1787848328.394152:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:8146:x1874694611413376:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787848328.394573:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:8146:x1874694611413376:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 425us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848328.394582:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 218 00000100:00100000:3.0:1787848328.447769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848328.448846:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611413504 00000100:00100000:0.0:1787848328.448863:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611413504 00000100:00100000:0.0:1787848328.448970:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 219 00000100:00100000:0.0:1787848328.448981:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:8146:x1874694611413504:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787848328.449599:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:8146:x1874694611413504:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 617us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848328.449610:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 219 00000100:00100000:2.0:1787848328.465541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848328.465663:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611413632 00000100:00100000:3.0:1787848328.465675:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611413632 00000100:00100000:3.0:1787848328.465737:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 220 00000100:00100000:3.0:1787848328.465748:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:8142:x1874694611413632:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787848328.465767:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848328.465785:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c7a00/0x9aeb41e0543cb5a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb163 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848328.465831:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c7a00/0x9aeb41e0543cb5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb163 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848328.465843:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c7a00/0x9aeb41e0543cb5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb163 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848328.465867:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c7a00, rc 0) 00000100:00100000:3.0:1787848328.466717:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:8142:x1874694611413632:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 966us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848328.466727:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 220 00000100:00100000:2.0:1787848328.500470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848328.500767:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611413760 00000100:00100000:0.0:1787848328.500780:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611413760 00000100:00100000:0.0:1787848328.500854:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 221 00000100:00100000:0.0:1787848328.500865:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:8142:x1874694611413760:12345-192.168.201.26@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787848328.500903:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787848328.500941:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787848328.500945:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787848328.500948:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787848328.500951:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787848328.504987:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:8142:x1874694611413760:12345-192.168.201.26@tcp:256:mount.lustre.0 Request processed in 4110us (4518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848328.505004:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 221 00000100:00100000:2.0:1787848328.513541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848328.513995:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611413888 00000100:00100000:3.0:1787848328.514009:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611413888 00000100:00100000:3.0:1787848328.514092:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 222 00000100:00100000:3.0:1787848328.514118:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:8142:x1874694611413888:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787848328.514151:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848328.514194:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c6800/0x9aeb41e0543cb5ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb16a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848328.514244:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c6800/0x9aeb41e0543cb5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb16a expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848328.514258:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c6800/0x9aeb41e0543cb5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb16a expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848328.514270:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c6800, rc 0) 00000100:00100000:3.0:1787848328.514365:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:8142:x1874694611413888:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 251us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848328.514374:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 222 00000100:00100000:2.0:1787848328.521484:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848328.521862:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611414016 00000100:00100000:1.0:1787848328.521879:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611414016 00000100:00100000:1.0:1787848328.521968:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 223 00000100:00100000:1.0:1787848328.521983:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:8142:x1874694611414016:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787848328.522518:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:8142:x1874694611414016:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 537us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848328.522529:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 223 00000100:00100000:0.0:1787848328.528795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848328.530361:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611414144 00000100:00100000:1.0:1787848328.530384:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611414144 00000100:00100000:1.0:1787848328.530489:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 224 00000100:00100000:1.0:1787848328.530501:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:8142:x1874694611414144:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787848328.531210:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:8142:x1874694611414144:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 388us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848328.531232:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 224 00000100:00100000:2.0:1787848328.538268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848328.538630:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611414272 00000100:00100000:3.0:1787848328.538690:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611414272 00000100:00100000:2.0:1787848328.540961:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 225 00000100:00100000:2.0:1787848328.540993:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:8151:x1874694611414272:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787848328.541407:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:8151:x1874694611414272:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 429us (3154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848328.541417:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 225 00000100:00100000:0.0:1787848328.554377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848328.557426:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611414400 00000100:00100000:2.0:1787848328.557448:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611414400 00000100:00100000:2.0:1787848328.558121:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 226 00000100:00100000:2.0:1787848328.558142:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:8151:x1874694611414400:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787848328.558553:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:8151:x1874694611414400:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 418us (4188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848328.558564:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 226 00000100:00100000:3.0:1787848328.571390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848328.571462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848328.571554:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611414528 00000100:00100000:3.0:1787848328.571567:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611414528 00000100:00100000:3.0:1787848328.571635:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611414912 00000100:00100000:3.0:1787848328.571675:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611414912 00000100:00100000:3.0:1787848328.572534:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00100000:3.0:1787848328.572552:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611414912:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848328.573364:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:0.0:1787848328.573375:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2350:x1874694611414528:12345-192.168.201.26@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787848328.573419:0:9224:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 13b431d3-ab16-497c-a7b0-79b9099e7ad1@192.168.201.26@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:0.0:1787848328.573472:0:9224:0:(genops.c:1385:class_connect()) connect: client 13b431d3-ab16-497c-a7b0-79b9099e7ad1, cookie 0x9aeb41e0543cb5b3 00000004:00100000:0.0:1787848328.573540:0:9224:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787848328.574356:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611414912:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 1801us (2883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848328.574373:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00080000:0.0:1787848328.582219:0:9224:0:(import.c:65:import_set_state_nolock()) ffff93ff431a0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787848328.584434:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2350:x1874694611414528:12345-192.168.201.26@tcp:38:mount.lustre.0 Request processed in 11038us (13040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848328.584456:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:3.0:1787848328.602925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848328.603240:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611414656 00000100:00100000:1.0:1787848328.603260:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611414656 00000100:00100000:1.0:1787848328.603373:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:1.0:1787848328.603389:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:0:x1874694611414656:12345-192.168.201.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787848328.603464:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787848328.603623:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:0:x1874694611414656:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 229us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848328.603632:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00080000:0.0:1787848328.605231:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848328.606390:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848328.607433:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611414784 00000100:00100000:3.0:1787848328.607456:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611414784 00000100:00100000:2.0:1787848328.609479:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787848328.609963:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:8142:x1874694611414784:12345-192.168.201.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787848328.610020:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787848328.610156:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:8142:x1874694611414784:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 662us (3777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848328.610165:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787848328.620848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848328.625339:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611415040 00000100:00100000:0.0:1787848328.625368:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611415040 00000100:00100000:0.0:1787848328.627940:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:0.0:1787848328.628006:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:8142:x1874694611415040:12345-192.168.201.26@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787848328.628366:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:8142:x1874694611415040:12345-192.168.201.26@tcp:40:mount.lustre.0 Request processed in 393us (7531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848328.634353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848328.634425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848328.635066:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:2.0:1787848328.636030:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611415168 00000100:00100000:2.0:1787848328.636045:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611415168 00000100:00100000:2.0:1787848328.636237:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611415296 00000100:00100000:2.0:1787848328.636243:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611415296 00000100:00100000:2.0:1787848328.636266:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787848328.636275:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1874694611415168:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787848328.636322:0:6689:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 13b431d3-ab16-497c-a7b0-79b9099e7ad1@192.168.201.26@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1787848328.636369:0:6689:0:(genops.c:1385:class_connect()) connect: client 13b431d3-ab16-497c-a7b0-79b9099e7ad1, cookie 0x9aeb41e0543cb5ba 00002000:00100000:2.0:1787848328.636388:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 13b431d3-ab16-497c-a7b0-79b9099e7ad1/ffff93ff5f354800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787848328.636436:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787848328.638867:0:6689:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787848328.638940:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93ff5f357800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787848328.639083:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2350:x1874694611415168:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 2805us (4744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848328.639098:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787848328.639139:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:2.0:1787848328.639147:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1874694611415296:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787848328.639184:0:6689:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 13b431d3-ab16-497c-a7b0-79b9099e7ad1@192.168.201.26@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1787848328.639216:0:6689:0:(genops.c:1385:class_connect()) connect: client 13b431d3-ab16-497c-a7b0-79b9099e7ad1, cookie 0x9aeb41e0543cb5c1 00002000:00100000:2.0:1787848328.639233:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 13b431d3-ab16-497c-a7b0-79b9099e7ad1/ffff93ff5f357000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787848328.639269:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787848328.639478:0:6689:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787848328.639496:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93ff5f351800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787848328.641307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848328.641444:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611415424 00000100:00100000:3.0:1787848328.641456:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611415424 00000100:00100000:3.0:1787848328.642078:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:3.0:1787848328.642106:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:8142:x1874694611415424:12345-192.168.201.26@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787848328.642492:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787848328.643232:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2350:x1874694611415296:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 4074us (8797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848328.643246:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:2.0:1787848328.649332:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:8142:x1874694611415424:12345-192.168.201.26@tcp:33:mount.lustre.0 Request processed in 7224us (8019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848328.649361:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00010000:00010000:1.0:1787848329.265815:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848330.288034:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787848330.765424:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 13b431d3-ab16-497c-a7b0-79b9099e7ad1 00000001:00100000:3.0:1787848331.250953:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 13b431d3-ab16-497c-a7b0-79b9099e7ad1 00010000:00010000:2.0:1787848331.312886:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848331.634169:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7929bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631374080:0@lo:400:kworker.0 00000100:00100000:0.0:1787848331.634298:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848331.634347:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631374080 00000100:00100000:1.0:1787848331.634359:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631374080 00000100:00100000:0.0:1787848331.634370:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631374592:0@lo:400:kworker.0 00000100:00100000:0.0:1787848331.634408:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848331.634434:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787848331.634440:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787848331.634448:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631374080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848331.634450:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7929b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631374208:0@lo:400:kworker.0 00000100:00100000:0.0:1787848331.634481:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848331.634516:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79299680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631374720:0@lo:400:kworker.0 00000100:00100000:1.0:1787848331.634540:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631374080:12345-0@lo:400:kworker.0 Request processed in 95us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848331.634550:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787848331.634555:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848331.634595:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7929bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631374080:0@lo:400:kworker.0 00000100:00100000:0.0:1787848331.634632:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7929a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631374464:0@lo:400:kworker.0 00000100:00100000:0.0:1787848331.634676:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848331.634698:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848331.634704:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631374336:0@lo:400:kworker.0 00000100:00100000:0.0:1787848331.634727:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848331.634776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631374592 00000100:00100000:0.0:1787848331.634780:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631374592 00000100:00100000:1.0:1787848331.634808:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631374720 00000100:00100000:1.0:1787848331.634814:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631374720 00000100:00100000:0.0:1787848331.634833:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631374208 00000100:00100000:0.0:1787848331.634838:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631374208 00000100:00100000:1.0:1787848331.634865:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631374464 00000100:00100000:0.0:1787848331.634867:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631374336 00000100:00100000:1.0:1787848331.634870:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631374464 00000100:00100000:0.0:1787848331.634872:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631374336 00000100:00100000:1.0:1787848331.634906:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787848331.634907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787848331.634919:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631374720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848331.634921:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631374592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848331.634978:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631374720:12345-0@lo:400:kworker.0 Request processed in 64us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848331.634996:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787848331.635009:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787848331.635016:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631374464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848331.635250:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631374464:12345-0@lo:400:kworker.0 Request processed in 234us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848331.635257:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787848331.635716:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787848331.635745:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79299e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631374208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848331.635814:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787848331.635826:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79298780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631374336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848331.635869:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79298780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631374336:12345-0@lo:400:kworker.0 Request processed in 46us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848331.635876:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1787848331.635903:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787848331.635909:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848331.635912:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848331.641248:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631374592:12345-0@lo:400:kworker.0 Request processed in 6312us (6821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848331.641272:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787848331.641409:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631374336:0@lo:400:kworker.0 00010000:00080000:0.0:1787848331.641432:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7929a1c0 x1874694631374464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848331.641446:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7929a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631374464:0@lo:400:kworker.0 00000100:00100000:3.0:1787848331.649795:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79299e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631374208:12345-0@lo:400:kworker.0 Request processed in 14047us (15290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848331.649818:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787848331.651294:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7929b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631374208:0@lo:400:kworker.0 00010000:00080000:1.0:1787848331.651410:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff79299680 x1874694631374720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848331.651426:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79299680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631374720:0@lo:400:kworker.0 00000100:00100000:1.0:1787848331.651444:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631374592:0@lo:400:kworker.0 00000100:00100000:3.0:1787848332.144457:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631374848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848332.144579:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848332.144860:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631374848 00000100:00100000:0.0:1787848332.144872:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631374848 00000100:00100000:0.0:1787848332.144947:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787848332.144966:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631374848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787848332.145026:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848332.145450:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631374848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 485us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848332.145461:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787848332.145491:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631374976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848332.145532:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787848332.145612:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5f40c000 x1874694631374848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848332.145635:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631374848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848332.161237:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631374976 00000100:00100000:2.0:1787848332.161261:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631374976 00000100:00100000:2.0:1787848332.168167:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787848332.168195:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631374976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848332.168273:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848332.168383:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631374976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (22850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848332.168392:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787848332.168834:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7956c000 x1874694631374976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848332.168865:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631374976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787848332.335840:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787848333.288931:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 13b431d3-ab16-497c-a7b0-79b9099e7ad1 00010000:00010000:2.0:1787848333.367060:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848334.020159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848334.020202:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848334.020242:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848334.020266:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848334.020294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848334.020332:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611415936 00000100:00100000:2.0:1787848334.020344:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611415936 00000100:00100000:2.0:1787848334.020420:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611416064 00000100:00100000:2.0:1787848334.020423:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611416064 00000100:00100000:2.0:1787848334.020445:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:2.0:1787848334.020456:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611415936:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848334.020556:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611415936:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 102us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848334.020565:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:2.0:1787848334.020584:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:2.0:1787848334.020591:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611416064:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848334.020616:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611416064:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848334.020623:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:3.0:1787848334.020933:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611415808 00000100:00100000:3.0:1787848334.020939:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611415808 00000100:00100000:3.0:1787848334.020985:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611415680 00000100:00100000:3.0:1787848334.020989:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611415680 00000100:00100000:3.0:1787848334.021033:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 81 00000100:00100000:3.0:1787848334.021040:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611415808:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848334.021081:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611415808:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 41us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848334.021101:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 81 00000100:00100000:3.0:1787848334.021116:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:3.0:1787848334.021123:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611415680:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848334.021152:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611415680:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 31us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848334.021158:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:1.0:1787848334.022523:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611415552 00000100:00100000:1.0:1787848334.022538:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611415552 00000100:00100000:1.0:1787848334.022607:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 228 00000100:00100000:1.0:1787848334.022616:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611415552:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848334.022754:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611415552:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 139us (2610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848334.022761:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 228 00000100:00080000:1.0:1787848334.022816:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787848334.022823:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848334.022826:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787848334.392809:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848335.408373:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848336.433578:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848336.752585:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787848336.752618:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631375360:0@lo:400:kworker.0 00000100:00100000:2.0:1787848336.752722:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848336.752822:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631375488:0@lo:400:kworker.0 00000100:00100000:2.0:1787848336.752852:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848336.752887:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631375488 00000100:00100000:2.0:1787848336.752895:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631375488 00000100:00100000:2.0:1787848336.752949:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787848336.752973:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631375488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848336.753031:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631375488:12345-0@lo:400:kworker.0 Request processed in 73us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848336.753039:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787848336.753081:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5f40f0c0 x1874694631375488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848336.753097:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631375488:0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.753417:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631375232:0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.753450:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848336.753479:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631375744:0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.753501:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848336.753530:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787848336.753544:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631375104:0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.753575:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848336.753599:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631375616:0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.753621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848336.753686:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631375360 00000100:00100000:3.0:1787848336.753690:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631375360 00000100:00100000:3.0:1787848336.753719:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631375232 00000100:00100000:3.0:1787848336.753722:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631375232 00000100:00100000:3.0:1787848336.753742:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631375616 00000100:00100000:3.0:1787848336.753744:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631375616 00000100:00100000:3.0:1787848336.753761:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787848336.753767:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631375360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.753816:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631375360:12345-0@lo:400:kworker.0 Request processed in 50us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848336.753832:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787848336.753847:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787848336.753853:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631375232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.753884:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631375232:12345-0@lo:400:kworker.0 Request processed in 31us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848336.753889:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787848336.753901:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787848336.753907:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631375616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.753933:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631375616:12345-0@lo:400:kworker.0 Request processed in 27us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848336.753938:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787848336.753956:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631375744 00000100:00100000:3.0:1787848336.753959:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631375744 00000100:00100000:3.0:1787848336.754005:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787848336.754012:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631375744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.754043:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631375744:12345-0@lo:400:kworker.0 Request processed in 32us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848336.754048:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787848336.754068:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631375104 00000100:00100000:3.0:1787848336.754070:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631375104 00000100:00100000:3.0:1787848336.754089:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787848336.754094:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631375104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.754119:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631375104:12345-0@lo:400:kworker.0 Request processed in 25us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848336.754124:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787848336.754162:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631375104:0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.754171:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631375616:0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.754179:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631375232:0@lo:400:kworker.0 00010000:00080000:3.0:1787848336.754188:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5f40cb40 x1874694631375744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848336.754196:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631375744:0@lo:400:kworker.0 00000100:00100000:3.0:1787848336.754234:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631375360:0@lo:400:kworker.0 00000100:00080000:1.0:1787848336.754943:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848336.754951:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787848336.754953:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848337.265187:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631375872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848337.265347:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848337.267037:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631375872 00000100:00100000:2.0:1787848337.267050:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631375872 00000100:00100000:2.0:1787848337.268339:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787848337.268364:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631375872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848337.268413:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848337.268502:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631375872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848337.268511:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787848337.268557:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631376000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787848337.268606:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787848337.268697:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5f40fc00 x1874694631375872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848337.268719:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631375872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848337.268744:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631376000 00000100:00100000:2.0:1787848337.268750:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631376000 00000100:00100000:2.0:1787848337.268774:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787848337.268779:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631376000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848337.268802:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848337.268836:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631376000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848337.268841:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787848337.268863:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e03c0 x1874694631376000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848337.268877:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631376000:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787848337.390863:0:10334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787848337.456822:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848338.480967:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848339.152952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848339.153055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848339.153903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848339.153946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848339.154209:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611416320 00000100:00100000:3.0:1787848339.154221:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611416320 00000100:00100000:3.0:1787848339.154278:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611416448 00000100:00100000:3.0:1787848339.154281:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611416448 00000100:00100000:3.0:1787848339.154304:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:3.0:1787848339.154314:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2354:x1874694611416320:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848339.154399:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2354:x1874694611416320:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 86us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848339.154408:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:3.0:1787848339.154428:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00100000:1.0:1787848339.154435:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611416576 00000100:00100000:3.0:1787848339.154436:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611416448:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848339.154443:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611416576 00000100:00100000:3.0:1787848339.154463:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611416448:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 27us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848339.154471:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00080000:3.0:1787848339.154490:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787848339.154494:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00080000:3.0:1787848339.154497:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848339.154509:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611416576:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848339.154547:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611416576:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 44us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848339.154556:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:2.0:1787848339.154619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848339.154727:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611416192 00000100:00100000:2.0:1787848339.154731:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611416192 00000100:00100000:2.0:1787848339.159152:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 230 00000100:00100000:2.0:1787848339.159193:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611416192:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848339.159273:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611416192:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 101us (6182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848339.159294:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 230 00000100:00100000:0.0:1787848339.162231:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611416704 00000100:00100000:0.0:1787848339.162244:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611416704 00000100:00080000:1.0:1787848339.162292:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787848339.162311:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:0.0:1787848339.162322:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611416704:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848339.162398:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611416704:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 78us (7779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848339.162406:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 51 00010000:00010000:1.0:1787848339.504860:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848340.533977:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848341.558734:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848341.871872:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631376384:0@lo:400:kworker.0 00000100:00100000:2.0:1787848341.871955:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848341.872023:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848341.872029:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631376512:0@lo:400:kworker.0 00000100:00100000:2.0:1787848341.872055:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848341.872092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631376384 00000100:00100000:2.0:1787848341.872099:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631376384 00000100:00100000:2.0:1787848341.872152:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787848341.872165:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631376384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848341.872217:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631376384:12345-0@lo:400:kworker.0 Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848341.872224:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787848341.872266:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631376384:0@lo:400:kworker.0 00000100:00100000:1.0:1787848341.872416:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631376128:0@lo:400:kworker.0 00000100:00100000:1.0:1787848341.872450:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848341.872485:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631376640:0@lo:400:kworker.0 00000100:00100000:1.0:1787848341.872507:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848341.872528:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787848341.872534:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631376256:0@lo:400:kworker.0 00000100:00100000:1.0:1787848341.872578:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848341.872596:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631376768:0@lo:400:kworker.0 00000100:00100000:1.0:1787848341.872616:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848341.872665:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631376512 00000100:00100000:1.0:1787848341.872669:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631376512 00000100:00100000:1.0:1787848341.872701:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631376768 00000100:00100000:1.0:1787848341.872704:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631376768 00000100:00100000:1.0:1787848341.872722:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787848341.872731:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631376512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848341.872769:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631376512:12345-0@lo:400:kworker.0 Request processed in 40us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848341.872775:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787848341.872788:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787848341.872794:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631376768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848341.872822:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631376768:12345-0@lo:400:kworker.0 Request processed in 29us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848341.872828:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787848341.872844:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848341.872847:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787848341.872850:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848341.872859:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631376640 00000100:00100000:1.0:1787848341.872926:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631376640 00000100:00100000:1.0:1787848341.872959:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631376256 00000100:00100000:1.0:1787848341.872962:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631376256 00000100:00100000:1.0:1787848341.872980:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787848341.872987:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631376640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848341.873016:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631376640:12345-0@lo:400:kworker.0 Request processed in 30us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848341.873031:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787848341.873043:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787848341.873049:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631376256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848341.873075:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631376256:12345-0@lo:400:kworker.0 Request processed in 26us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848341.873081:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787848341.873108:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848341.873129:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631376256:0@lo:400:kworker.0 00010000:00080000:1.0:1787848341.873142:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d0a580 x1874694631376768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848341.873152:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631376768:0@lo:400:kworker.0 00000100:00100000:1.0:1787848341.873162:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631376640:0@lo:400:kworker.0 00010000:00080000:1.0:1787848341.873193:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff58d08000 x1874694631376512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848341.873202:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631376512:0@lo:400:kworker.0 00000100:00100000:2.0:1787848341.873350:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631376128 00000100:00100000:2.0:1787848341.873354:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631376128 00000100:00100000:2.0:1787848341.873391:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787848341.873398:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631376128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848341.873432:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631376128:12345-0@lo:400:kworker.0 Request processed in 35us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848341.873438:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787848341.873509:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631376128:0@lo:400:kworker.0 00000100:00100000:0.0:1787848342.388971:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848342.388993:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631376896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848342.389066:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848342.389130:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631376896 00000100:00100000:0.0:1787848342.389136:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631376896 00000100:00100000:0.0:1787848342.389195:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787848342.389203:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79299680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631376896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787848342.389240:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848342.389283:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79299680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631376896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848342.389290:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787848342.389328:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff79298f00 x1874694631376896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848342.389345:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631376896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848342.400136:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631377024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848342.400213:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848342.400277:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631377024 00000100:00100000:3.0:1787848342.400285:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631377024 00000100:00100000:3.0:1787848342.400329:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787848342.400338:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631377024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787848342.400375:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848342.400422:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631377024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848342.400431:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787848342.400471:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e1a40 x1874694631377024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848342.400488:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631377024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787848342.575817:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848343.606933:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848344.266903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848344.266950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848344.266985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848344.267017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848344.267061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848344.267191:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611417088 00000100:00100000:1.0:1787848344.267201:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611417088 00000100:00100000:1.0:1787848344.267281:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611416960 00000100:00100000:1.0:1787848344.267285:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611416960 00000100:00100000:1.0:1787848344.267312:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:1.0:1787848344.267322:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611417088:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848344.267408:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611417088:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 87us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848344.267416:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:1.0:1787848344.267433:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00100000:1.0:1787848344.267440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611416960:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848344.267465:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611416960:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848344.267471:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00100000:1.0:1787848344.267493:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611417344 00000100:00100000:1.0:1787848344.267497:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611417344 00000100:00100000:1.0:1787848344.267533:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611417216 00000100:00100000:1.0:1787848344.267536:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611417216 00000100:00100000:1.0:1787848344.267553:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:1.0:1787848344.267559:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611417344:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848344.267587:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611417344:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 28us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848344.267594:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:0.0:1787848344.267604:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:0.0:1787848344.267617:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611417216:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848344.267675:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611417216:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 62us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848344.267682:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00080000:2.0:1787848344.267985:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787848344.267990:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787848344.267992:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848344.268088:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611416832 00000100:00100000:3.0:1787848344.268093:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611416832 00000100:00100000:3.0:1787848344.268137:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 232 00000100:00100000:3.0:1787848344.268144:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2351:x1874694611416832:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848344.268185:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2351:x1874694611416832:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 41us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848344.268192:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 232 00010000:00010000:0.0:1787848344.623799:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848345.656748:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848346.672779:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848346.992109:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787848346.994110:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631377280:0@lo:400:kworker.0 00000100:00100000:3.0:1787848346.994209:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848346.994374:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631377152:0@lo:400:kworker.0 00000100:00100000:3.0:1787848346.994406:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848346.994633:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631377280 00000100:00100000:0.0:1787848346.994660:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631377280 00000100:00100000:1.0:1787848346.996602:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631377152 00000100:00100000:1.0:1787848346.996620:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631377152 00000100:00100000:2.0:1787848347.000262:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631377408:0@lo:400:kworker.0 00000100:00100000:2.0:1787848347.000350:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848347.000543:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787848347.000565:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631377664:0@lo:400:kworker.0 00000100:00100000:1.0:1787848347.000595:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848347.004000:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631377536:0@lo:400:kworker.0 00000100:00100000:3.0:1787848347.004080:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848347.004150:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631377536 00000100:00100000:3.0:1787848347.004158:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631377536 00000100:00100000:3.0:1787848347.004242:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787848347.004252:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631377536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848347.010894:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631377536:12345-0@lo:400:kworker.0 Request processed in 6632us (6801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848347.010910:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787848347.010992:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5f40c000 x1874694631377536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848347.011008:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631377536:0@lo:400:kworker.0 00000100:00100000:3.0:1787848347.011066:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631377792:0@lo:400:kworker.0 00000100:00100000:3.0:1787848347.011127:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848347.011182:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631377792 00000100:00100000:3.0:1787848347.011188:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631377792 00000100:00100000:3.0:1787848347.011231:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787848347.011239:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631377792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848347.011284:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631377792:12345-0@lo:400:kworker.0 Request processed in 47us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848347.011289:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787848347.012945:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff559b0000 x1874694631377792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848347.012960:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631377792:0@lo:400:kworker.0 00000100:00100000:3.0:1787848347.013024:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631377408 00000100:00100000:3.0:1787848347.013031:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631377408 00000100:00100000:0.0:1787848347.013376:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631377664 00000100:00100000:0.0:1787848347.013381:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631377664 00000100:00100000:1.0:1787848347.013457:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787848347.013485:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631377280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848347.013580:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631377280:12345-0@lo:400:kworker.0 Request processed in 113us (19371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848347.013587:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787848347.013685:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787848347.013690:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787848347.013693:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848347.013735:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631377280:0@lo:400:kworker.0 00000100:00100000:2.0:1787848347.013783:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631377152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848347.013824:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631377152:12345-0@lo:400:kworker.0 Request processed in 13271us (19418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848347.013832:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787848347.013866:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631377152:0@lo:400:kworker.0 00000100:00100000:3.0:1787848347.014692:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787848347.014707:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631377408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848347.014773:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631377408:12345-0@lo:400:kworker.0 Request processed in 72us (14423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848347.014779:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787848347.014817:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631377408:0@lo:400:kworker.0 00000100:00100000:0.0:1787848347.017854:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787848347.017883:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631377664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848347.017980:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631377664:12345-0@lo:400:kworker.0 Request processed in 112us (17383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848347.017987:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787848347.018094:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631377664:0@lo:400:kworker.0 00000100:00100000:0.0:1787848347.503845:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848347.503870:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631377920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848347.503954:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848347.504022:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631377920 00000100:00100000:0.0:1787848347.504030:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631377920 00000100:00100000:0.0:1787848347.504077:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787848347.504087:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631377920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787848347.504124:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848347.504181:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631377920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848347.504188:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787848347.504242:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff79298f00 x1874694631377920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848347.504258:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631377920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848347.507348:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631378048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848347.507413:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848347.507535:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631378048 00000100:00100000:2.0:1787848347.507543:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631378048 00000100:00100000:2.0:1787848347.507596:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787848347.507607:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79298f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631378048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848347.507762:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848347.507852:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79298f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631378048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848347.507861:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787848347.512726:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff559b3c00 x1874694631378048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848347.512761:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631378048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787848347.701500:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848348.733695:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848349.401146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848349.401192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848349.401220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848349.401261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848349.401288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848349.401314:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611417600 00000100:00100000:2.0:1787848349.401323:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611417600 00000100:00100000:2.0:1787848349.401391:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611417728 00000100:00100000:2.0:1787848349.401395:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611417728 00000100:00100000:2.0:1787848349.401450:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:2.0:1787848349.401462:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611417600:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848349.401543:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611417600:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 83us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848349.401550:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:2.0:1787848349.401569:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00100000:2.0:1787848349.401576:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611417728:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848349.401601:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611417728:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848349.401607:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00100000:2.0:1787848349.401627:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611417856 00000100:00100000:2.0:1787848349.401630:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611417856 00000100:00100000:2.0:1787848349.401682:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611417984 00000100:00100000:2.0:1787848349.401686:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611417984 00000100:00100000:2.0:1787848349.401703:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:2.0:1787848349.401709:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2350:x1874694611417856:12345-192.168.201.26@tcp:9:kworker.0 00000100:00100000:1.0:1787848349.401904:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611417472 00000100:00100000:1.0:1787848349.401908:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611417472 00000100:00100000:1.0:1787848349.401953:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 234 00000100:00100000:1.0:1787848349.401962:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611417472:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848349.401989:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611417472:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 30us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848349.401994:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 234 00000100:00080000:3.0:1787848349.402741:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848349.402748:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848349.402751:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787848349.403302:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb5ba 00000100:00080000:2.0:1787848349.403316:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93ff5f357800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787848349.403368:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1787848349.404632:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848349.407152:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+2:2350:x1874694611417856:12345-192.168.201.26@tcp:9:kworker.0 Request processed in 5429us (5876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848349.407183:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:2.0:1787848349.407216:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:2.0:1787848349.407228:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2350:x1874694611417984:12345-192.168.201.26@tcp:9:kworker.0 00000020:00000080:2.0:1787848349.407256:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb5c1 00000100:00080000:2.0:1787848349.407265:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93ff5f351800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787848349.407310:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787848349.407662:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+2:2350:x1874694611417984:12345-192.168.201.26@tcp:9:kworker.0 Request processed in 414us (6348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848349.407670:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00010000:00010000:3.0:1787848349.408328:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848349.743879:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848350.769822:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787848351.151812:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 13b431d3-ab16-497c-a7b0-79b9099e7ad1 00000020:00000080:2.0:1787848351.151823:0:7658:0:(genops.c:885:class_export_put()) final put ffff93ff5f357000/13b431d3-ab16-497c-a7b0-79b9099e7ad1 00000020:00000080:1.0:1787848351.152533:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f357000/13b431d3-ab16-497c-a7b0-79b9099e7ad1 for lustre-OST0001 00000020:00000080:1.0:1787848351.152587:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff5f351800 for lustre-OST0001 00010000:00010000:1.0:1787848351.793822:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848352.117776:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631378432:0@lo:400:kworker.0 00000100:00100000:3.0:1787848352.117857:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848352.117922:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848352.117928:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631378560:0@lo:400:kworker.0 00000100:00100000:3.0:1787848352.117953:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848352.117993:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631378560 00000100:00100000:3.0:1787848352.117999:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631378560 00000100:00100000:3.0:1787848352.118050:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787848352.118059:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631378560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848352.118109:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631378560:12345-0@lo:400:kworker.0 Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848352.118116:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787848352.118136:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787848352.118168:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5f40c3c0 x1874694631378560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848352.118181:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631378560:0@lo:400:kworker.0 00000100:00100000:0.0:1787848352.118321:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631378432 00000100:00100000:0.0:1787848352.118325:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631378432 00000100:00100000:0.0:1787848352.118362:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787848352.118369:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631378432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848352.118415:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631378432:12345-0@lo:400:kworker.0 Request processed in 47us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848352.118422:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1787848352.118442:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848352.118631:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631378432:0@lo:400:kworker.0 00000100:00100000:2.0:1787848352.121332:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631378176:0@lo:400:kworker.0 00000100:00100000:2.0:1787848352.121414:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848352.121473:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631378688:0@lo:400:kworker.0 00000100:00100000:2.0:1787848352.121502:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848352.121530:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787848352.121537:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631378304:0@lo:400:kworker.0 00000100:00100000:2.0:1787848352.121558:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848352.121578:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631378816:0@lo:400:kworker.0 00000100:00100000:2.0:1787848352.121601:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848352.121636:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631378688 00000100:00100000:2.0:1787848352.121666:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631378688 00000100:00100000:2.0:1787848352.121728:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631378304 00000100:00100000:2.0:1787848352.121731:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631378304 00000100:00100000:2.0:1787848352.121750:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787848352.121766:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631378688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848352.121817:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631378688:12345-0@lo:400:kworker.0 Request processed in 53us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848352.121824:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787848352.121840:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787848352.121846:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631378304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848352.121874:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631378304:12345-0@lo:400:kworker.0 Request processed in 28us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848352.121879:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787848352.121900:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631378816 00000100:00100000:2.0:1787848352.121904:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631378816 00000100:00100000:2.0:1787848352.121930:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787848352.121937:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631378816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848352.121971:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631378816:12345-0@lo:400:kworker.0 Request processed in 35us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848352.121978:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787848352.122013:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631378304:0@lo:400:kworker.0 00010000:00080000:2.0:1787848352.122027:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5317c000 x1874694631378816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848352.122038:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631378816:0@lo:400:kworker.0 00000100:00100000:2.0:1787848352.122046:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631378688:0@lo:400:kworker.0 00000100:00100000:0.0:1787848352.122345:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631378176 00000100:00100000:0.0:1787848352.122356:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631378176 00000100:00100000:0.0:1787848352.122397:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787848352.122405:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631378176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848352.122444:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631378176:12345-0@lo:400:kworker.0 Request processed in 39us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848352.122450:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787848352.122489:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631378176:0@lo:400:kworker.0 00000100:00080000:0.0:1787848352.122513:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787848352.122518:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848352.623821:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848352.623845:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631378944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848352.623927:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848352.623995:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631378944 00000100:00100000:3.0:1787848352.624002:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631378944 00000100:00100000:3.0:1787848352.624050:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787848352.624059:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631378944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787848352.624098:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848352.624143:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631378944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848352.624164:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787848352.624206:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5317fc00 x1874694631378944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848352.624224:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631378944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848352.627784:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787848352.627811:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631379072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848352.627889:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848352.627955:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631379072 00000100:00100000:1.0:1787848352.627962:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631379072 00000100:00100000:1.0:1787848352.628018:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787848352.628027:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631379072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787848352.628064:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848352.628109:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631379072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848352.628123:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787848352.628176:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7956fc00 x1874694631379072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848352.628196:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631379072:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787848352.821132:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787848353.835102:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 13b431d3-ab16-497c-a7b0-79b9099e7ad1 00000020:00000080:0.0:1787848353.835113:0:6716:0:(genops.c:885:class_export_put()) final put ffff93ff5f354800/13b431d3-ab16-497c-a7b0-79b9099e7ad1 00000020:00000080:0.0:1787848353.835918:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f354800/13b431d3-ab16-497c-a7b0-79b9099e7ad1 for lustre-OST0000 00000020:00000080:0.0:1787848353.835968:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff5f357800 for lustre-OST0000 00010000:00010000:0.0:1787848353.842495:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848354.500471:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848354.500546:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848354.500577:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848354.500682:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611418368 00000100:00100000:2.0:1787848354.500692:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611418368 00000100:00100000:2.0:1787848354.500762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611418240 00000100:00100000:2.0:1787848354.500765:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611418240 00000100:00100000:2.0:1787848354.500812:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 101 00000100:00100000:2.0:1787848354.500821:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611418368:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848354.500892:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611418368:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 72us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848354.500900:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 101 00000100:00100000:2.0:1787848354.500916:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00100000:2.0:1787848354.500922:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611418240:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848354.500943:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611418240:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 22us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848354.500948:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00080000:1.0:1787848354.501591:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848354.507174:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611418112 00000100:00100000:3.0:1787848354.507188:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611418112 00000100:00100000:3.0:1787848354.507318:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 236 00000100:00100000:3.0:1787848354.507328:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2351:x1874694611418112:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848354.507436:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2351:x1874694611418112:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 109us (6984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848354.507444:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 236 00010000:00010000:2.0:1787848354.864760:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848355.888552:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848356.912904:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848357.232047:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631379200:0@lo:400:kworker.0 00000100:00100000:3.0:1787848357.232122:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848357.232170:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631379712:0@lo:400:kworker.0 00000100:00100000:3.0:1787848357.232196:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848357.232224:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787848357.232230:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631379328:0@lo:400:kworker.0 00000100:00100000:3.0:1787848357.232251:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848357.232271:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631379840:0@lo:400:kworker.0 00000100:00100000:3.0:1787848357.232305:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848357.232334:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631379584:0@lo:400:kworker.0 00000100:00100000:3.0:1787848357.232378:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848357.232400:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848357.232413:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631379456:0@lo:400:kworker.0 00000100:00100000:3.0:1787848357.232437:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848357.232485:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631379200 00000100:00100000:3.0:1787848357.232493:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631379200 00000100:00100000:1.0:1787848357.238498:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631379712 00000100:00100000:1.0:1787848357.238515:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631379712 00000100:00100000:1.0:1787848357.238569:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631379328 00000100:00100000:1.0:1787848357.238572:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631379328 00000100:00100000:1.0:1787848357.238590:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631379456 00000100:00100000:1.0:1787848357.238593:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631379456 00000100:00100000:1.0:1787848357.238614:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787848357.238624:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631379712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848357.238743:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631379712:12345-0@lo:400:kworker.0 Request processed in 119us (6544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848357.238751:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787848357.238769:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787848357.238775:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631379328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848357.238802:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631379328:12345-0@lo:400:kworker.0 Request processed in 28us (6550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848357.238809:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787848357.238818:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787848357.238832:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631379456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848357.238866:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631379456:12345-0@lo:400:kworker.0 Request processed in 34us (6427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848357.238872:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787848357.238891:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631379840 00000100:00100000:1.0:1787848357.238895:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631379840 00000100:00100000:1.0:1787848357.238921:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631379584 00000100:00100000:1.0:1787848357.238924:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631379584 00000100:00100000:1.0:1787848357.238938:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787848357.238943:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631379840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848357.238973:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631379840:12345-0@lo:400:kworker.0 Request processed in 30us (6667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848357.238978:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787848357.238986:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787848357.238992:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631379584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848357.239018:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631379584:12345-0@lo:400:kworker.0 Request processed in 26us (6639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848357.239025:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1787848357.239051:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787848357.239055:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848357.239057:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848357.239254:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787848357.239264:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631379200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848357.239316:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631379200:12345-0@lo:400:kworker.0 Request processed in 54us (7194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848357.239322:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787848357.239379:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631379456:0@lo:400:kworker.0 00010000:00080000:1.0:1787848357.239403:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5317d680 x1874694631379584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848357.239414:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631379584:0@lo:400:kworker.0 00000100:00100000:1.0:1787848357.239450:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631379328:0@lo:400:kworker.0 00010000:00080000:1.0:1787848357.239461:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5f40fc00 x1874694631379840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848357.239471:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631379840:0@lo:400:kworker.0 00000100:00100000:1.0:1787848357.239480:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631379200:0@lo:400:kworker.0 00000100:00100000:1.0:1787848357.239491:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631379712:0@lo:400:kworker.0 00000100:00100000:2.0:1787848357.743954:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631379968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848357.744028:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848357.744176:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631379968 00000100:00100000:1.0:1787848357.744184:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631379968 00000100:00100000:1.0:1787848357.744236:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787848357.744246:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631379968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787848357.744318:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848357.744374:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631379968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848357.744381:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787848357.744481:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7956f0c0 x1874694631379968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848357.744500:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631379968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848357.745069:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631380096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848357.745106:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848357.745294:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631380096 00000100:00100000:1.0:1787848357.745299:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631380096 00000100:00100000:1.0:1787848357.745367:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787848357.745375:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631380096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848357.745411:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848357.747928:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631380096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2545us (2813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848357.747960:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1787848357.748092:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb4000 x1874694631380096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848357.754448:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631380096:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787848357.935835:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848358.967810:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787848359.080737:0:11038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787848359.639836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848359.639878:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848359.639935:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848359.640042:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611418752 00000100:00100000:2.0:1787848359.640052:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611418752 00000100:00100000:2.0:1787848359.640111:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611418624 00000100:00100000:2.0:1787848359.640114:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611418624 00000100:00100000:2.0:1787848359.640139:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 106 00000100:00100000:2.0:1787848359.640148:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611418752:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848359.640237:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611418752:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848359.640254:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 106 00000100:00100000:2.0:1787848359.640274:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 107 00000100:00100000:2.0:1787848359.640282:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611418624:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848359.640325:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611418624:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 45us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848359.640330:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 107 00000100:00080000:1.0:1787848359.640825:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848359.641114:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611418496 00000100:00100000:3.0:1787848359.641121:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611418496 00000100:00100000:3.0:1787848359.641166:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 238 00000100:00100000:3.0:1787848359.641175:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611418496:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848359.641234:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611418496:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 60us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848359.641241:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 238 00010000:00010000:0.0:1787848359.984197:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848361.010661:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848362.033706:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848362.352873:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7964bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631380608:0@lo:400:kworker.0 00000100:00100000:3.0:1787848362.352951:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848362.353015:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848362.353022:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff796483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631380480:0@lo:400:kworker.0 00000100:00100000:3.0:1787848362.353050:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848362.353124:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631380352:0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.353154:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848362.353181:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631380864:0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.353212:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848362.353236:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787848362.353242:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7964a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631380224:0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.353269:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848362.353291:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7964b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631380736:0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.353311:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848362.353346:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631380224 00000100:00100000:2.0:1787848362.353353:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631380224 00000100:00100000:2.0:1787848362.353398:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787848362.353408:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631380224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.353457:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631380224:12345-0@lo:400:kworker.0 Request processed in 51us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848362.353465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787848362.353499:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631380480 00000100:00100000:2.0:1787848362.353503:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631380480 00000100:00100000:2.0:1787848362.353549:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631380352 00000100:00100000:2.0:1787848362.353552:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631380352 00000100:00100000:2.0:1787848362.353569:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631380736 00000100:00100000:2.0:1787848362.353572:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631380736 00000100:00100000:2.0:1787848362.353599:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787848362.353605:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631380480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.353668:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631380480:12345-0@lo:400:kworker.0 Request processed in 62us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848362.353674:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787848362.353686:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787848362.353692:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631380352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.353718:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631380352:12345-0@lo:400:kworker.0 Request processed in 27us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848362.353724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787848362.353735:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787848362.353741:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631380736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.353765:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631380736:12345-0@lo:400:kworker.0 Request processed in 25us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848362.353770:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1787848362.353788:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848362.353823:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff796483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631380480:0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.353849:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7964a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631380224:0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.353858:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7964b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631380736:0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.353867:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631380352:0@lo:400:kworker.0 00000100:00100000:1.0:1787848362.354147:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631380608 00000100:00100000:1.0:1787848362.354152:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631380608 00000100:00080000:2.0:1787848362.354220:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787848362.354275:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631380864 00000100:00100000:1.0:1787848362.354279:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631380864 00000100:00100000:1.0:1787848362.354310:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787848362.354315:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787848362.354317:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631380608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.354322:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631380864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848362.354357:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631380864:12345-0@lo:400:kworker.0 Request processed in 36us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848362.354357:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631380608:12345-0@lo:400:kworker.0 Request processed in 41us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848362.354363:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787848362.354368:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1787848362.354393:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff79648000 x1874694631380864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787848362.354393:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7964bc00 x1874694631380608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848362.354405:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631380864:0@lo:400:kworker.0 00000100:00100000:1.0:1787848362.354405:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7964bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631380608:0@lo:400:kworker.0 00000100:00080000:3.0:1787848362.354444:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787848362.863989:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631380992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848362.864072:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848362.864210:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631380992 00000100:00100000:3.0:1787848362.864221:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631380992 00000100:00100000:3.0:1787848362.864994:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787848362.865008:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631380992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787848362.865069:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848362.865755:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631381120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848362.865803:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848362.865851:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787848362.865860:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1787848362.866029:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631381120 00000100:00100000:1.0:1787848362.866035:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631381120 00000100:00100000:1.0:1787848362.866171:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787848362.866180:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631381120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848362.866229:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848362.866268:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631381120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848362.866275:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787848362.866314:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff78eb7c00 x1874694631381120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848362.866331:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631381120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848362.866675:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631380992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1670us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848362.866683:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787848362.866860:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7956c3c0 x1874694631380992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848362.866875:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631380992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787848363.058623:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787848363.861287:0:11187:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc530b2c0 20000000:00000080:1.0:1787848363.861899:0:11187:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ff50beec00 uarg=0000000000000000 20000000:01000000:1.0:1787848363.861937:0:11187:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787848363.861943:0:11187:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787848363.861948:0:11187:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787848363.867573:0:11188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787848363.867910:0:11187:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787848363.870852:0:11187:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787848363.870885:0:11187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.870903:0:11187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff444c7e00/0x9aeb41e0543cb574 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb56d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.870911:0:11187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb57b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.870919:0:11187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cb590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb589 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.870928:0:11187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb132 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.870953:0:11187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff444c6800/0x9aeb41e0543cb5ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb16a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.870960:0:11187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.870997:0:11187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff444c6800/0x9aeb41e0543cb5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb16a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.871012:0:11187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff444c6800/0x9aeb41e0543cb5ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb16a expref: 12 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848363.871026:0:11187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1874694631381248:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787848363.871131:0:11187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb132 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.871139:0:11187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb597 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb132 expref: 12 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848363.871147:0:11187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1874694631381376:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787848363.879354:0:11187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cb590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb589 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.879436:0:11187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cb590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb589 expref: 18 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848363.879461:0:11187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1874694631381504:0@lo:104: 00000100:00100000:0.0:1787848363.879691:0:11187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787848363.879765:0:11187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb57b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848363.879774:0:11187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb582 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb57b expref: 18 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848363.879797:0:11187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1874694631381632:0@lo:104: 00000100:00100000:0.0:1787848363.879821:0:11187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787848363.879845:0:11187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff444c7e00/0x9aeb41e0543cb574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb56d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848363.879854:0:11187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff444c7e00/0x9aeb41e0543cb574 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb56d expref: 18 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848363.879862:0:11187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1874694631381760:0@lo:104: 00000100:00100000:0.0:1787848363.879883:0:11187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848363.879894:0:11187:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6913c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848363.879924:0:11187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1874694631381248:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848363.879935:0:11187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1874694631381376:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848363.879996:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631381504 00000100:00100000:3.0:1787848363.880004:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631381504 00000100:00100000:3.0:1787848363.880045:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631381632 00000100:00100000:3.0:1787848363.880048:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631381632 00000100:00100000:3.0:1787848363.880058:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631381760 00000100:00100000:3.0:1787848363.880060:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631381760 00000100:00100000:3.0:1787848363.880071:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787848363.880080:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:11187:x1874694631381504:12345-0@lo:104: 00010000:00010000:3.0:1787848363.880092:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.880155:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787848363.880161:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:11187:x1874694631381504:12345-0@lo:104: Request processed in 82us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848363.880168:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787848363.880194:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787848363.880200:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+4:11187:x1874694631381632:12345-0@lo:104: 00010000:00010000:3.0:1787848363.880207:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880222:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848363.880234:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.880236:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787848363.880241:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+4:11187:x1874694631381632:12345-0@lo:104: Request processed in 42us (421us total) trans 0 rc 0/0 00010000:00010000:1.0:1787848363.880242:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5600 already unused, calling callback (ffffffffc1b83c20) 00000100:00100000:3.0:1787848363.880246:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:00010000:1.0:1787848363.880246:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880255:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848363.880262:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 10000000:00010000:1.0:1787848363.880262:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848363.880267:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:11187:x1874694631381760:12345-0@lo:104: 10000000:01000000:1.0:1787848363.880269:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787848363.880275:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880297:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.880299:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787848363.880304:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:11187:x1874694631381760:12345-0@lo:104: Request processed in 37us (420us total) trans 0 rc 0/0 00010000:00010000:1.0:1787848363.880304:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787848363.880308:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787848363.880321:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880328:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a5600/0x9aeb41e0543cb589 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb590 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880339:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787848363.880342:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880349:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5e00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848363.880351:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880368:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848363.880374:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848363.880379:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787848363.880393:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880398:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848363.880404:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880411:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a5e00/0x9aeb41e0543cb57b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880420:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848363.880423:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880428:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a4a00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848363.880431:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880436:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848363.880442:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848363.880454:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787848363.880468:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880474:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848363.880502:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880510:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a4a00/0x9aeb41e0543cb56d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848363.880533:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848363.880535:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848363.880537:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848363.880555:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631381888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787848363.880588:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848363.880614:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787848363.880620:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631382016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787848363.880973:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631382144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787848363.881000:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848363.881094:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631381888 00000100:00100000:3.0:1787848363.881098:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631381888 00010000:00010000:3.0:1787848363.881117:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cb590 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb589 expref: 19 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848363.881135:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631382144 00000100:00100000:3.0:1787848363.881138:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631382144 00010000:00010000:3.0:1787848363.881147:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff444c7e00/0x9aeb41e0543cb574 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb56d expref: 20 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848363.881165:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787848363.881182:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff50bb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+20:3310:x1874694631381888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848363.881195:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848363.881201:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cb590 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb589 expref: 20 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.881210:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cb590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb589 expref: 20 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.881239:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848363.881264:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff50bb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+20:3310:x1874694631381888:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848363.881271:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787848363.881311:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787848363.881318:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631382144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848363.881325:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848363.881329:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff444c7e00/0x9aeb41e0543cb574 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb56d expref: 19 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.881336:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff444c7e00/0x9aeb41e0543cb574 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb56d expref: 19 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.881344:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848363.881370:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631382144:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848363.881375:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787848363.881402:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631382144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787848363.881514:0:11187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cb590 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb589 expref: 18 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848363.881526:0:11187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1874694631381504:0@lo:104: 00000100:00100000:0.0:1787848363.881534:0:11187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1874694631381632:0@lo:104: 00010000:00010000:0.0:1787848363.881541:0:11187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c7e00/0x9aeb41e0543cb574 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb56d expref: 17 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848363.881547:0:11187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1874694631381760:0@lo:104: 00010000:00010000:0.0:1787848363.881582:0:11187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.882303:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848363.883056:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848363.883125:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631381888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787848363.883377:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631382016 00000100:00100000:3.0:1787848363.883385:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631382016 00010000:00010000:3.0:1787848363.883417:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb582 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb57b expref: 17 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848363.883469:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787848363.883478:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:3310:x1874694631382016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848363.883495:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848363.883512:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb582 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb57b expref: 17 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.883523:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb57b expref: 17 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.883541:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff414a4600/0x9aeb41e0543cb582 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb57b expref: 17 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.883566:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848363.883625:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3310:x1874694631382016:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848363.883632:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787848363.884349:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631382016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787848363.902196:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848363.902238:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848363.902299:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611418880 00000100:00100000:2.0:1787848363.902311:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611418880 00010000:00010000:2.0:1787848363.902354:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff444c6800/0x9aeb41e0543cb5ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb16a expref: 13 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848363.902396:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611419008 00000100:00100000:2.0:1787848363.902409:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611419008 00010000:00010000:2.0:1787848363.902421:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb597 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb132 expref: 14 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848363.902440:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:2.0:1787848363.902449:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b6bbff9-6edf-442f-a60a-abc2c14840e9+14:2351:x1874694611418880:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848363.902465:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848363.902471:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff444c6800/0x9aeb41e0543cb5ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb16a expref: 14 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902505:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff444c6800/0x9aeb41e0543cb5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb16a expref: 14 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902535:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c6800/0x9aeb41e0543cb5ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb16a expref: 14 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902554:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848363.902608:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2351:x1874694611418880:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 160us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848363.902617:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:2.0:1787848363.902672:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:2.0:1787848363.902680:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:2351:x1874694611419008:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848363.902688:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848363.902693:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb597 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb132 expref: 12 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902702:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb132 expref: 12 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902711:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb597 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb132 expref: 12 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902724:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902733:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902760:0:8522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902767:0:8522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902773:0:8522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902780:0:8522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902786:0:8522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ee00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848363.902790:0:8522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902797:0:8522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902813:0:8522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848363.902824:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848363.902845:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:2351:x1874694611419008:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 166us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848363.902852:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 29 00010000:00010000:3.0:1787848363.904276:0:11187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.904292:0:11187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848363.904299:0:11187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff5f42ee00/0x9aeb41e0543cb5c8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848364.081478:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848364.739905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848364.739960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848364.740034:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611419136 00000100:00100000:1.0:1787848364.740047:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611419136 00000100:00100000:1.0:1787848364.740142:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611419264 00000100:00100000:1.0:1787848364.740146:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611419264 00000100:00100000:1.0:1787848364.740193:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 111 00000100:00100000:1.0:1787848364.740204:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611419136:12345-192.168.201.26@tcp:400:kworker.0 00000100:00080000:3.0:1787848364.740314:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848364.740408:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611419136:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 206us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848364.752406:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00100000:0.0:1787848364.752438:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611419264:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848364.752552:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611419264:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 132us (12590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848364.752563:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00100000:1.0:1787848364.771748:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 111 00000100:00100000:0.0:1787848364.999831:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848364.999945:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611419392 00000100:00100000:1.0:1787848364.999957:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611419392 00000100:00100000:1.0:1787848365.000022:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 240 00000100:00100000:1.0:1787848365.000034:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:5596:x1874694611419392:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848365.000055:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848365.000075:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff5f42fe00/0x9aeb41e0543cb5cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb194 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848365.000105:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff5f42fe00/0x9aeb41e0543cb5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb194 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848365.000118:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff5f42fe00/0x9aeb41e0543cb5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb194 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848365.000127:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42fe00, rc 0) 00000100:00100000:1.0:1787848365.000204:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611419392:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 172us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848365.000212:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 240 00000100:00100000:0.0:1787848365.006879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848365.007002:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611419520 00000100:00100000:3.0:1787848365.007018:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611419520 00000100:00100000:3.0:1787848365.007094:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 241 00000100:00100000:3.0:1787848365.007974:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611419520:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787848365.008415:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611419520:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 453us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848365.008427:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 241 00000100:00100000:0.0:1787848365.024726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848365.025749:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611419648 00000100:00100000:1.0:1787848365.025767:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611419648 00000100:00100000:1.0:1787848365.025876:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 242 00000100:00100000:1.0:1787848365.025890:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611419648:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848365.026174:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611419648:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 287us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848365.026198:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 242 00000100:00100000:1.0:1787848365.037413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848365.038057:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611419776 00000100:00100000:3.0:1787848365.038080:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611419776 00000100:00100000:3.0:1787848365.038145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 243 00000100:00100000:3.0:1787848365.038166:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611419776:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848365.038198:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848365.038226:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c6600/0x9aeb41e0543cb5d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb19b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848365.038269:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c6600/0x9aeb41e0543cb5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb19b expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848365.038286:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c6600/0x9aeb41e0543cb5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb19b expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848365.038567:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c6600, rc 0) 00000100:00100000:3.0:1787848365.038693:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:5596:x1874694611419776:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 539us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848365.038702:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 243 00000100:00100000:1.0:1787848365.043397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848365.043901:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611419904 00000100:00100000:0.0:1787848365.043916:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611419904 00000100:00100000:0.0:1787848365.044037:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 244 00000100:00100000:0.0:1787848365.044051:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:5596:x1874694611419904:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848365.044655:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:5596:x1874694611419904:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 588us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848365.044666:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 244 00000100:00100000:1.0:1787848365.052733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848365.052863:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611420032 00000100:00100000:2.0:1787848365.052876:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611420032 00000100:00100000:2.0:1787848365.052948:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 245 00000100:00100000:2.0:1787848365.052967:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:5596:x1874694611420032:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.053290:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:5596:x1874694611420032:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 322us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848365.053300:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 245 00010000:00010000:1.0:1787848365.106044:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787848365.554433:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787848365.554446:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93fe41342800 from 7 10000000:01000000:1.0:1787848365.554454:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787848365.554527:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848365.554541:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848365.554557:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848365.554600:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787848365.554849:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848365.554932:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848365.555112:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631382272 00000100:00100000:0.0:1787848365.555122:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631382272 00000100:00100000:0.0:1787848365.555225:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787848365.555236:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631382272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787848365.555254:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848365.555277:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40030400/0x9aeb41e0543cb5e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb5dd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848365.555309:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40030400/0x9aeb41e0543cb5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb5dd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848365.555340:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40030400/0x9aeb41e0543cb5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb5dd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848365.555352:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030400, rc 0) 00000100:00100000:0.0:1787848365.555414:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631382272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848365.555422:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787848365.555694:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848365.555714:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.555724:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848365.555810:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.555850:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848365.555889:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5821a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787848365.556027:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631382400 00000100:00100000:1.0:1787848365.556033:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631382400 00000100:00100000:1.0:1787848365.556077:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787848365.556086:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631382400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848365.556476:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631382400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 389us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848365.556484:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787848365.556532:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848365.556582:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848365.556627:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848365.556683:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848365.556697:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631382528 00000100:00100000:1.0:1787848365.556701:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631382528 00000100:00100000:1.0:1787848365.556723:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787848365.556729:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631382528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848365.556910:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631382528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848365.556917:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787848365.556952:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787848365.567289:0:11215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787848365.567633:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787848365.567711:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787848365.567727:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.567742:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848365.567755:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787848365.567759:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff4314e000 from 7 10000000:01000000:2.0:1787848365.567762:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787848365.567820:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.567852:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.567877:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848365.567912:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.568012:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848365.568080:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5821a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787848365.568375:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631382656 00000100:00100000:3.0:1787848365.568387:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631382656 00000100:00100000:3.0:1787848365.568463:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787848365.568476:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631382656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848365.568496:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848365.568515:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff444c7400/0x9aeb41e0543cb5f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb5eb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848365.568554:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff444c7400/0x9aeb41e0543cb5f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb5eb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848365.568583:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff444c7400/0x9aeb41e0543cb5f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb5eb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848365.568595:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c7400, rc 0) 00000100:00100000:3.0:1787848365.568666:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631382656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848365.568674:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787848365.569876:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848365.569911:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.569925:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848365.570047:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.570137:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848365.570231:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5821a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787848365.570405:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631382784 00000100:00100000:0.0:1787848365.570412:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631382784 00000100:00100000:0.0:1787848365.570468:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787848365.570480:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631382784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848365.570894:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631382784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 416us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848365.570902:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787848365.571027:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.571071:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.571120:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848365.571164:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5821a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787848365.571181:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631382912 00000100:00100000:2.0:1787848365.571185:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631382912 00000100:00100000:2.0:1787848365.571223:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787848365.571229:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631382912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.571400:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631382912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848365.571407:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787848365.571444:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631382912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787848365.572209:0:11218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787848365.572315:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787848365.572337:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787848365.572352:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.572367:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848365.572382:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787848365.572386:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff506b3000 from 7 10000000:01000000:2.0:1787848365.572390:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787848365.572430:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.572439:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.572449:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848365.572471:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631383040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.572525:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848365.572564:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5821a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787848365.572585:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631383040 00000100:00100000:2.0:1787848365.572592:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631383040 00000100:00100000:2.0:1787848365.572631:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787848365.572668:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631383040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848365.572682:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848365.572697:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50664200/0x9aeb41e0543cb600 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb5f9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.572726:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50664200/0x9aeb41e0543cb600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb5f9 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.572739:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50664200/0x9aeb41e0543cb600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb5f9 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.572749:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664200, rc 0) 00000100:00100000:2.0:1787848365.572787:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631383040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848365.572794:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787848365.572838:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631383040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848365.572852:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.572862:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848365.572908:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631383168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.572932:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848365.572952:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5821a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787848365.572961:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631383168 00000100:00100000:2.0:1787848365.572964:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631383168 00000100:00100000:2.0:1787848365.572981:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787848365.572986:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631383168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.573288:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631383168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848365.573295:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787848365.573334:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631383168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.573361:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631383296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.573399:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848365.573411:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5821a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787848365.573420:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631383296 00000100:00100000:2.0:1787848365.573423:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631383296 00000100:00100000:2.0:1787848365.573439:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787848365.573444:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631383296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848365.573596:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631383296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848365.573604:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787848365.573637:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631383296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787848365.587543:0:11219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787848365.598598:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787848365.598683:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787848365.598703:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848365.598719:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848366.127951:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848367.151956:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848367.475690:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631383808:0@lo:400:kworker.0 00000100:00100000:1.0:1787848367.475790:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848367.475870:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787848367.475877:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631383424:0@lo:400:kworker.0 00000100:00100000:1.0:1787848367.475909:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848367.475932:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631383936:0@lo:400:kworker.0 00000100:00100000:1.0:1787848367.475957:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848367.475983:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631383680:0@lo:400:kworker.0 00000100:00100000:1.0:1787848367.476004:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848367.476021:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787848367.476026:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631383552:0@lo:400:kworker.0 00000100:00100000:1.0:1787848367.476059:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848367.476093:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631384064:0@lo:400:kworker.0 00000100:00100000:1.0:1787848367.476128:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848367.476159:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631383808 00000100:00100000:1.0:1787848367.476167:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631383808 00000100:00100000:0.0:1787848367.476388:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631383936 00000100:00100000:0.0:1787848367.476393:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631383936 00000100:00100000:0.0:1787848367.476434:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631383680 00000100:00100000:0.0:1787848367.476437:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631383680 00000100:00100000:0.0:1787848367.476456:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631383552 00000100:00100000:0.0:1787848367.476458:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631383552 00000100:00100000:0.0:1787848367.476471:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787848367.476480:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631383936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848367.476551:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631383936:12345-0@lo:400:kworker.0 Request processed in 72us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848367.476559:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787848367.476577:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787848367.476591:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631383680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848367.476629:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631383680:12345-0@lo:400:kworker.0 Request processed in 38us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848367.476634:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787848367.476667:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787848367.476673:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631383552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848367.476698:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631383552:12345-0@lo:400:kworker.0 Request processed in 26us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848367.476704:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787848367.476750:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631383552:0@lo:400:kworker.0 00000100:00100000:0.0:1787848367.476761:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631383680:0@lo:400:kworker.0 00000100:00100000:0.0:1787848367.476791:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631383936:0@lo:400:kworker.0 00000100:00100000:1.0:1787848367.476879:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631384064 00000100:00100000:1.0:1787848367.476883:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631384064 00000100:00100000:1.0:1787848367.476904:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787848367.476911:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631383808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848367.476947:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631383808:12345-0@lo:400:kworker.0 Request processed in 36us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848367.476953:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787848367.476967:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787848367.476972:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631384064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848367.477003:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631384064:12345-0@lo:400:kworker.0 Request processed in 31us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848367.477009:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787848367.477027:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631383424 00000100:00100000:1.0:1787848367.477031:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631383424 00000100:00100000:1.0:1787848367.477142:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787848367.477149:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631383424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848367.477181:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631383424:12345-0@lo:400:kworker.0 Request processed in 34us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848367.477187:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:1.0:1787848367.477304:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848367.477309:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787848367.477311:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787848367.477398:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5317fc00 x1874694631384064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848367.477409:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631384064:0@lo:400:kworker.0 00000100:00100000:0.0:1787848367.477430:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631383424:0@lo:400:kworker.0 00010000:00080000:0.0:1787848367.477440:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7956c3c0 x1874694631383808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848367.477447:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631383808:0@lo:400:kworker.0 00000100:00100000:2.0:1787848367.983822:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787848367.983858:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631384192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848367.983930:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848367.984002:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631384192 00000100:00100000:2.0:1787848367.984010:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631384192 00000100:00100000:2.0:1787848367.984066:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787848367.984075:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631384192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848367.984123:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848367.984169:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631384192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848367.984177:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787848367.984230:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb483c0 x1874694631384192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848367.984258:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631384192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848367.986606:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787848367.986628:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631384320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787848367.986720:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848367.986884:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631384320 00000100:00100000:3.0:1787848367.986892:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631384320 00000100:00100000:3.0:1787848367.986935:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787848367.986942:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631384320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787848367.986975:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848367.987019:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631384320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848367.987026:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1787848367.987061:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb483c0 x1874694631384320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848367.987078:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631384320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787848368.181458:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787848369.123315:0:11386:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787848369.200229:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848369.872295:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848369.872369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848369.872418:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848369.872603:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611420416 00000100:00100000:2.0:1787848369.872618:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611420416 00000100:00100000:2.0:1787848369.872744:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611420288 00000100:00100000:2.0:1787848369.872748:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611420288 00000100:00100000:2.0:1787848369.872777:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 116 00000100:00100000:2.0:1787848369.872792:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611420416:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848369.872917:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611420416:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 129us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848369.872927:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 116 00000100:00100000:2.0:1787848369.872951:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00100000:2.0:1787848369.872959:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2354:x1874694611420288:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848369.872985:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2354:x1874694611420288:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 28us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848369.872992:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00080000:1.0:1787848369.873229:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848369.873720:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611420160 00000100:00100000:3.0:1787848369.873728:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611420160 00000100:00100000:3.0:1787848369.873780:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 256 00000100:00100000:3.0:1787848369.873790:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611420160:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848369.873844:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611420160:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 57us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848369.873852:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 256 00010000:00010000:1.0:1787848370.226171:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848371.248007:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848372.272970:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848372.592169:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631384448:0@lo:400:kworker.0 00000100:00100000:3.0:1787848372.592288:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848372.592403:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631384448 00000100:00100000:1.0:1787848372.592416:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631384448 00000100:00100000:1.0:1787848372.592493:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787848372.592506:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3313:x1874694631384448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.593928:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631384576:0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.594009:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848372.594125:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631384704:0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.594154:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848372.594187:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631384576 00000100:00100000:2.0:1787848372.594196:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631384576 00000100:00100000:2.0:1787848372.594245:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631384704 00000100:00100000:2.0:1787848372.594248:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631384704 00000100:00100000:2.0:1787848372.594278:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787848372.594286:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631384576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.594332:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631384576:12345-0@lo:400:kworker.0 Request processed in 46us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848372.594340:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787848372.594361:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787848372.594367:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631384704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.594399:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631384704:12345-0@lo:400:kworker.0 Request processed in 32us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848372.594424:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787848372.594482:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631384704:0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.594516:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631384576:0@lo:400:kworker.0 00000100:00100000:1.0:1787848372.594907:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3313:x1874694631384448:12345-0@lo:400:kworker.0 Request processed in 2401us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848372.594918:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:1.0:1787848372.594969:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848372.595273:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631384832:0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.595325:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848372.595393:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848372.595400:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631384960:0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.595424:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848372.595455:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631384960 00000100:00100000:2.0:1787848372.595461:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631384960 00000100:00100000:2.0:1787848372.595517:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787848372.595524:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631384960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.595572:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631384960:12345-0@lo:400:kworker.0 Request processed in 48us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848372.595578:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787848372.595593:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848372.595615:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631384960:0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.595681:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631385088:0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.595708:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848372.595741:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631384832 00000100:00100000:2.0:1787848372.595745:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631384832 00000100:00100000:2.0:1787848372.595778:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631385088 00000100:00100000:2.0:1787848372.595781:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631385088 00000100:00100000:2.0:1787848372.595798:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787848372.595805:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631384832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848372.596004:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787848372.596014:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787848372.596275:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631384832:12345-0@lo:400:kworker.0 Request processed in 469us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848372.596283:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787848372.596299:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787848372.596306:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631385088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848372.596342:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631385088:12345-0@lo:400:kworker.0 Request processed in 37us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848372.596348:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787848372.596368:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787848372.596372:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787848372.596399:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb492c0 x1874694631384832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848372.596412:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631384832:0@lo:400:kworker.0 00010000:00080000:2.0:1787848372.596438:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff805c4f00 x1874694631385088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848372.596447:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631385088:0@lo:400:kworker.0 00000100:00100000:3.0:1787848372.598626:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631384448:0@lo:400:kworker.0 00000100:00100000:3.0:1787848373.106276:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787848373.106315:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631385216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848373.106434:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848373.106669:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631385216 00000100:00100000:1.0:1787848373.106682:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631385216 00000100:00100000:1.0:1787848373.106761:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787848373.106773:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79648780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631385216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787848373.106819:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848373.106888:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79648780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631385216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848373.106896:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787848373.106974:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff805c4f00 x1874694631385216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848373.106998:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631385216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848373.110058:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848373.110095:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631385344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848373.110276:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848373.110430:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631385344 00000100:00100000:2.0:1787848373.110441:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631385344 00000100:00100000:2.0:1787848373.110510:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787848373.110524:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631385344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848373.110576:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848373.110689:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631385344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848373.110698:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787848373.110861:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff805c4f00 x1874694631385344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848373.110886:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631385344:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787848373.308933:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787848373.491862:0:11487:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:32:52 (1787848372) === 00000100:00100000:0.0:1787848373.756986:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848373.757058:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848373.757154:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611420672 00000100:00100000:3.0:1787848373.757169:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611420672 00000100:00100000:3.0:1787848373.757261:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:3.0:1787848373.757274:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:9697:x1874694611420672:12345-192.168.201.26@tcp:700:mkdir.0 00000100:00080000:0.0:1787848373.757529:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848373.757721:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:9697:x1874694611420672:12345-192.168.201.26@tcp:700:mkdir.0 Request processed in 129us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848373.757732:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:2.0:1787848373.757952:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611420544 00000100:00100000:2.0:1787848373.757958:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611420544 00000100:00100000:2.0:1787848373.758015:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:2.0:1787848373.758025:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611420544:12345-192.168.201.26@tcp:41:mkdir.0 00000004:00000024:2.0:1787848373.758071:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787848373.758169:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611420544:12345-192.168.201.26@tcp:41:mkdir.0 Request processed in 146us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848373.758177:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:1.0:1787848373.762756:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848373.762868:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611420928 00000100:00100000:2.0:1787848373.762883:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611420928 00000100:00100000:2.0:1787848373.762963:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:2.0:1787848373.762976:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:9697:x1874694611420928:12345-192.168.201.26@tcp:36:mkdir.0 00010000:00010000:2.0:1787848373.763068:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848373.763331:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb4e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb11d expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.763367:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff53a89e00) 00010000:00010000:2.0:1787848373.763382:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848373.763845:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb607 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.763862:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb607 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.763873:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb607 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.763923:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664600/0x9aeb41e0543cb60e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.763931:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664600/0x9aeb41e0543cb60e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.763938:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664600/0x9aeb41e0543cb60e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848373.765908:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787848373.765930:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb607 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.765940:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb607 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.765948:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb607 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.765956:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848373.765962:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb607 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.765972:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb607 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.765992:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:2.0:1787848373.765995:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848373.777130:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb607 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.777176:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb607 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787848373.777217:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7f828fa reply state 00000000a72484d9 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664600/0x9aeb41e0543cb60e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848373.777227:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787848373.777635:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:9697:x1874694611420928:12345-192.168.201.26@tcp:36:mkdir.0 Request processed in 14648us (14879us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787848373.777672:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00010000:00010000:0.0:1787848373.785028:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664600/0x9aeb41e0543cb60e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.785055:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664600/0x9aeb41e0543cb60e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.785066:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664600/0x9aeb41e0543cb60e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.785076:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848373.785083:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664600/0x9aeb41e0543cb60e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.785094:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664600/0x9aeb41e0543cb60e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.785125:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93ff53a89300) 00010000:00010000:0.0:1787848373.785130:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848373.785138:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664600/0x9aeb41e0543cb60e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.787615:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664600/0x9aeb41e0543cb60e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848373.798681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848373.798737:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611421056 00000100:00100000:0.0:1787848373.798751:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611421056 00000100:00100000:0.0:1787848373.798827:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:0.0:1787848373.798840:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:9698:x1874694611421056:12345-192.168.201.26@tcp:101:chmod.0 00010000:00010000:0.0:1787848373.798892:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848373.798921:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1a2 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.799027:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031c00/0x9aeb41e0543cb61c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.799045:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031c00/0x9aeb41e0543cb61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.799060:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031c00/0x9aeb41e0543cb61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848373.799144:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787848373.799149:0:7097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848373.799206:0:7097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031c00/0x9aeb41e0543cb61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.799239:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1a2 expref: 8 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.799265:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031c00/0x9aeb41e0543cb61c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1a2 expref: 7 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848373.799275:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373700) 00010000:00010000:0.0:1787848373.799279:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848373.799284:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40031c00, rc 0) 00000100:00100000:0.0:1787848373.799378:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:9698:x1874694611421056:12345-192.168.201.26@tcp:101:chmod.0 Request processed in 541us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848373.799387:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:3.0:1787848373.808964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848373.809695:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611421312 00000100:00100000:3.0:1787848373.809714:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611421312 00000100:00100000:3.0:1787848373.809824:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:3.0:1787848373.809839:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff796492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:9698:x1874694611421312:12345-192.168.201.26@tcp:36:chmod.0 00010000:00010000:3.0:1787848373.809922:0:9224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848373.809968:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031c00/0x9aeb41e0543cb61c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1a2 expref: 7 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.810010:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373700) 00010000:00010000:3.0:1787848373.810028:0:9224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848373.810070:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb623 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.810090:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb623 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.810104:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb623 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787848373.813842:0:9224:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000464680ef reply state 0000000073eddaa7 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb623 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848373.813870:0:9224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787848373.813912:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787848373.814093:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff796492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:9698:x1874694611421312:12345-192.168.201.26@tcp:36:chmod.0 Request processed in 4251us (5139us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787848373.814106:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00010000:00010000:3.0:1787848373.821279:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb623 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.821321:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb623 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.821360:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb623 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.821367:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c6400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848373.821372:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb623 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.821382:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb623 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.821420:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1300) 00010000:00010000:3.0:1787848373.821424:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787848373.821432:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb623 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.821440:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb623 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848373.852248:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848373.852513:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611421440 00000100:00100000:3.0:1787848373.852528:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611421440 00000100:00100000:3.0:1787848373.852611:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:3.0:1787848373.852624:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:9699:x1874694611421440:12345-192.168.201.26@tcp:101:chown.0 00010000:00010000:3.0:1787848373.852811:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848373.852851:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb62a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1a9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.852980:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6800/0x9aeb41e0543cb631 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.853009:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6800/0x9aeb41e0543cb631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.853045:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6800/0x9aeb41e0543cb631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848373.853135:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787848373.853140:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848373.853197:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6800/0x9aeb41e0543cb631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.853230:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb62a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1a9 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.853253:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6800/0x9aeb41e0543cb631 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1a9 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.853261:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1300) 00010000:00010000:3.0:1787848373.853264:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787848373.853268:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c6800, rc 0) 00000100:00100000:3.0:1787848373.853577:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:9699:x1874694611421440:12345-192.168.201.26@tcp:101:chown.0 Request processed in 955us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848373.853587:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:1.0:1787848373.861173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848373.862056:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611421568 00000100:00100000:0.0:1787848373.862075:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611421568 00000100:00100000:1.0:1787848373.862551:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:1.0:1787848373.862566:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:9699:x1874694611421568:12345-192.168.201.26@tcp:101:chown.0 00010000:00010000:1.0:1787848373.862622:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848373.862779:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1b0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.862884:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb63f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.862909:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb63f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.862925:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb63f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.862946:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb646 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.862953:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.862960:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863110:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb64d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863119:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863125:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848373.863180:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787848373.863195:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848373.863231:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863248:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb63f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863255:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb63f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863261:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb63f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863268:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848373.863273:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb63f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863282:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb63f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863544:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1300) 00010000:00010000:1.0:1787848373.863548:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848373.863555:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb63f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863563:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb63f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863580:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863586:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb646 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863605:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863610:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ea00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848373.863614:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863622:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb646 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863630:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93ff43951300) 00010000:00010000:1.0:1787848373.863633:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848373.863636:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb646 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863789:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb646 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863845:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1b0 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863863:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb64d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1b0 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.863872:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff43951200) 00010000:00010000:1.0:1787848373.863875:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787848373.863878:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f200, rc 0) 00000100:00100000:1.0:1787848373.864034:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:9699:x1874694611421568:12345-192.168.201.26@tcp:101:chown.0 Request processed in 1469us (2876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848373.864057:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:1.0:1787848373.869061:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848373.869186:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611421824 00000100:00100000:3.0:1787848373.869206:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611421824 00000100:00100000:3.0:1787848373.869348:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:3.0:1787848373.869364:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:9699:x1874694611421824:12345-192.168.201.26@tcp:36:chown.0 00010000:00010000:3.0:1787848373.869475:0:9224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848373.869519:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb64d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1b0 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.869573:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff43951200) 00010000:00010000:3.0:1787848373.869593:0:9224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848373.869672:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb654 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.869692:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.869706:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787848373.937037:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:3.0:1787848373.937078:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1787848373.937128:0:9224:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074ef0500 reply state 000000009420830a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848373.937145:0:9224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787848373.937520:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1787848373.937738:0:9224:0:(ldlm_lib.c:3492:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787848373.937771:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:9699:x1874694611421824:12345-192.168.201.26@tcp:36:chown.0 Request processed in 68406us (68727us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787848373.937783:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00010000:00010000:2.0:1787848373.937893:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.937905:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb654 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.937914:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb654 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.937921:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c6400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848373.937926:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb654 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.937935:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb654 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.937954:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff541a1200) 00010000:00010000:2.0:1787848373.937958:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787848373.937963:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb654 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848373.937969:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb654 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848373.961606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848373.962243:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611421952 00000100:00100000:3.0:1787848373.962259:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611421952 00000100:00100000:3.0:1787848373.962423:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:3.0:1787848373.962436:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:9700:x1874694611421952:12345-192.168.201.26@tcp:101:touch.500 00010000:00010000:3.0:1787848373.962476:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848373.962507:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7e00/0x9aeb41e0543cb65b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787848373.967631:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5024us 00010000:00010000:3.0:1787848373.983452:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb662 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.983483:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb662 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.983499:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb662 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.983519:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb669 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.983527:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb669 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.983534:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb669 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984178:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6e00/0x9aeb41e0543cb670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984193:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6e00/0x9aeb41e0543cb670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984202:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6e00/0x9aeb41e0543cb670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848373.984298:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787848373.984304:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848373.984426:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6e00/0x9aeb41e0543cb670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984447:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb662 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984455:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb662 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984463:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb662 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984471:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c7c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848373.984478:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb662 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984487:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb662 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984505:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1300) 00010000:00010000:3.0:1787848373.984509:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848373.984515:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb662 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984522:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb662 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984538:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb669 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984544:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb669 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984550:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb669 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984562:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c6c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848373.984565:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb669 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984571:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb669 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984580:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93ff541a1800) 00010000:00010000:3.0:1787848373.984582:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848373.984585:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb669 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984591:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb669 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984686:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7e00/0x9aeb41e0543cb65b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1b7 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984705:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6e00/0x9aeb41e0543cb670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1b7 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848373.984714:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:3.0:1787848373.984717:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787848373.984719:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c6e00, rc 0) 00000100:00100000:3.0:1787848373.984836:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:9700:x1874694611421952:12345-192.168.201.26@tcp:101:touch.500 Request processed in 22401us (23244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848373.984848:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:2.0:1787848373.989098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848373.989196:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611422208 00000100:00100000:1.0:1787848373.989210:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611422208 00000100:00100000:1.0:1787848373.989331:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:1.0:1787848373.989344:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:9700:x1874694611422208:12345-192.168.201.26@tcp:101:touch.500 00010000:00010000:1.0:1787848373.989373:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848373.989400:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb677 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1be expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.989875:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb67e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.989896:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb67e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.989910:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb67e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.991824:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cb685 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.991870:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cb685 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848373.991886:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cb685 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787848373.994614:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787848374.000678:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cb68c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.000705:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cb68c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.000718:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cb68c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.000760:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb67e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.000769:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb67e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.000777:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb67e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.000784:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848374.000789:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb67e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.000797:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb67e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.000811:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:1.0:1787848374.000814:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848374.000819:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb67e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.000827:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb67e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787848374.004683:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d08fe4ff reply state 000000008912d77e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cb685 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848374.004704:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787848374.004780:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cb677 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1be expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.004809:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cb68c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1be expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.004820:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ff43951f00) 00010000:00010000:1.0:1787848374.004824:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787848374.004828:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f000, rc 0) 00000100:00100000:1.0:1787848374.006378:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:9700:x1874694611422208:12345-192.168.201.26@tcp:101:touch.500 Request processed in 17024us (17284us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787848374.006393:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00010000:00010000:0.0:1787848374.014636:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cb685 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.014700:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cb685 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.014708:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cb685 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.014715:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848374.014722:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cb685 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.014731:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cb685 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.014755:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff93ff43951300) 00010000:00010000:0.0:1787848374.014758:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848374.014764:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cb685 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.014770:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cb685 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848374.018900:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848374.019058:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611422464 00000100:00100000:3.0:1787848374.019090:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611422464 00000100:00100000:3.0:1787848374.019169:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:3.0:1787848374.019181:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:9700:x1874694611422464:12345-192.168.201.26@tcp:36:touch.500 00010000:00010000:3.0:1787848374.019255:0:9224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848374.019289:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cb68c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1be expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.019318:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ff43951f00) 00010000:00010000:3.0:1787848374.019333:0:9224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848374.019392:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb69a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.019421:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb69a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.019433:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb69a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787848374.019622:0:9224:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033210d64 reply state 0000000025ab3f29 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb69a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848374.019634:0:9224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787848374.019817:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:9700:x1874694611422464:12345-192.168.201.26@tcp:36:touch.500 Request processed in 636us (931us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787848374.019827:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:1.0:1787848374.032731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848374.032855:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611422592 00000100:00100000:0.0:1787848374.032876:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611422592 00000100:00100000:0.0:1787848374.032964:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:0.0:1787848374.032978:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:9700:x1874694611422592:12345-192.168.201.26@tcp:101:touch.500 00010000:00010000:0.0:1787848374.033026:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848374.033079:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb6a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1c5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.033169:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb6a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1c5 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.033188:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb6a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1c5 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.033213:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ff541a1800) 00010000:00010000:0.0:1787848374.033217:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787848374.033222:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030000, rc 0) 00000100:00100000:0.0:1787848374.033447:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+11:9700:x1874694611422592:12345-192.168.201.26@tcp:101:touch.500 Request processed in 471us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848374.033456:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 24 00010000:00010000:3.0:1787848374.033840:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb69a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.033871:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb69a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.033911:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb69a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.033916:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c6000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848374.033921:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb69a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.033929:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb69a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.033947:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ff541a1800) 00010000:00010000:3.0:1787848374.033951:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848374.033956:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb69a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.033963:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb69a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848374.041249:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848374.041490:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611422720 00000100:00100000:2.0:1787848374.041514:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611422720 00000100:00100000:2.0:1787848374.041584:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:2.0:1787848374.041594:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1874694611422720:12345-192.168.201.26@tcp:8:touch.500 00010000:00080000:2.0:1787848374.041681:0:6689:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:2.0:1787848374.041721:0:6689:0:(genops.c:1385:class_connect()) connect: client 8bb0bb0f-4511-40a8-bdfa-25f441891529, cookie 0x9aeb41e0543cb6a8 00002000:00100000:2.0:1787848374.041737:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8bb0bb0f-4511-40a8-bdfa-25f441891529/ffff93ff5f354800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787848374.041752:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787848374.042125:0:6689:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787848374.042166:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93ff5f357000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787848374.042885:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2350:x1874694611422720:12345-192.168.201.26@tcp:8:touch.500 Request processed in 1287us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848374.042898:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:2.0:1787848374.051279:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848374.051372:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611422848 00000100:00100000:3.0:1787848374.051382:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611422848 00000100:00100000:3.0:1787848374.051465:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:3.0:1787848374.051476:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:0:x1874694611422848:12345-192.168.201.26@tcp:2:touch.500 00000100:00080000:0.0:1787848374.051824:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787848374.162052:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:0:x1874694611422848:12345-192.168.201.26@tcp:2:touch.500 Request processed in 110567us (110773us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787848374.162066:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000001:00100000:2.0:1787848374.162405:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00000001:00080000:2.0:1787848374.162431:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1787848374.169703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848374.169796:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611423104 00000100:00100000:2.0:1787848374.169806:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611423104 00000100:00100000:2.0:1787848374.169880:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:2.0:1787848374.169900:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:9700:x1874694611423104:12345-192.168.201.26@tcp:35:touch.500 00000100:00100000:2.0:1787848374.170477:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+11:9700:x1874694611423104:12345-192.168.201.26@tcp:35:touch.500 Request processed in 587us (786us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787848374.170487:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:0.0:1787848374.204201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848374.204584:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611423232 00000100:00100000:1.0:1787848374.204595:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611423232 00000100:00100000:1.0:1787848374.204699:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:1.0:1787848374.204711:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+11:9701:x1874694611423232:12345-192.168.201.26@tcp:101:rm.0 00010000:00010000:1.0:1787848374.204735:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848374.204769:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb6af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1cc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.204848:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cb6b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.205209:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cb6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.205226:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cb6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848374.205367:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787848374.205372:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848374.205423:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cb6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.205457:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cb6af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1cc expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.205480:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cb6b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1cc expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848374.205501:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:0.0:1787848374.205505:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848374.205509:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f800, rc 0) 00000100:00100000:0.0:1787848374.205632:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:9701:x1874694611423232:12345-192.168.201.26@tcp:101:rm.0 Request processed in 922us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848374.205677:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:3.0:1787848374.213028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848374.213143:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611423488 00000100:00100000:2.0:1787848374.213166:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611423488 00000100:00100000:2.0:1787848374.213234:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:2.0:1787848374.213244:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:9701:x1874694611423488:12345-192.168.201.26@tcp:101:rm.0 00010000:00010000:2.0:1787848374.213268:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848374.213289:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb6bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848374.213423:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787848374.213612:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb6bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1d3 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.213628:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1300) 00010000:00010000:2.0:1787848374.213631:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787848374.213637:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb6bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1d3 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.214217:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665e00, rc 0) 00000100:00100000:3.0:1787848374.217061:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:9701:x1874694611423488:12345-192.168.201.26@tcp:101:rm.0 Request processed in 3805us (4030us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787848374.217075:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:2.0:1787848374.221457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848374.221825:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611423616 00000100:00100000:0.0:1787848374.221840:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611423616 00000100:00100000:0.0:1787848374.221920:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:0.0:1787848374.221931:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:9701:x1874694611423616:12345-192.168.201.26@tcp:37:rm.0 00000100:00100000:2.0:1787848374.239215:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:9701:x1874694611423616:12345-192.168.201.26@tcp:37:rm.0 Request processed in 17273us (17754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848374.239230:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:3.0:1787848374.252629:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848374.254113:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611423872 00000100:00100000:2.0:1787848374.254132:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611423872 00000100:00100000:2.0:1787848374.254224:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:2.0:1787848374.254235:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff520d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:9701:x1874694611423872:12345-192.168.201.26@tcp:35:rm.0 00000100:00100000:2.0:1787848374.254973:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff520d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:9701:x1874694611423872:12345-192.168.201.26@tcp:35:rm.0 Request processed in 736us (2358us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787848374.255009:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:0.0:1787848374.268836:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848374.269050:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611424128 00000100:00100000:3.0:1787848374.269073:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611424128 00000100:00100000:3.0:1787848374.269134:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:3.0:1787848374.269144:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:9701:x1874694611424128:12345-192.168.201.26@tcp:101:rm.0 00010000:00010000:3.0:1787848374.269172:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848374.269196:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1da expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.269516:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7e00/0x9aeb41e0543cb6d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.269534:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7e00/0x9aeb41e0543cb6d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.269545:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7e00/0x9aeb41e0543cb6d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848374.269557:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787848374.269711:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1da expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.269731:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7e00/0x9aeb41e0543cb6d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1da expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.269739:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:3.0:1787848374.269742:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787848374.269745:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c7e00, rc 0) 00000100:00100000:3.0:1787848374.269873:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:9701:x1874694611424128:12345-192.168.201.26@tcp:101:rm.0 Request processed in 729us (1047us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787848374.269881:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:0.0:1787848374.280135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848374.280249:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611424256 00000100:00100000:2.0:1787848374.280258:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611424256 00000100:00100000:2.0:1787848374.280320:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:2.0:1787848374.280331:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:9701:x1874694611424256:12345-192.168.201.26@tcp:41:rm.0 00000004:00000024:2.0:1787848374.280399:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787848374.280503:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:9701:x1874694611424256:12345-192.168.201.26@tcp:41:rm.0 Request processed in 173us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848374.280512:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:2.0:1787848374.294423:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848374.294685:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611424384 00000100:00100000:3.0:1787848374.294698:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611424384 00000100:00100000:3.0:1787848374.294768:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:3.0:1787848374.294779:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:9701:x1874694611424384:12345-192.168.201.26@tcp:101:rm.0 00010000:00010000:3.0:1787848374.294812:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848374.294838:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1e1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.294910:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb6e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.294926:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.294939:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.294954:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb6ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.294961:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb6ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.294967:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb6ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295113:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb6f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295121:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295148:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848374.295177:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787848374.295181:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848374.295198:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295210:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295218:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295224:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb6e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295231:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295241:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c6c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848374.295246:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295253:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb6e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295264:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:3.0:1787848374.295267:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848374.295272:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb6e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295289:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb6e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295312:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb6ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295318:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb6ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295324:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb6ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295329:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c7c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848374.295332:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb6ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295338:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb6ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295347:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff93ff541a1700) 00010000:00010000:3.0:1787848374.295350:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848374.295352:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb6ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295358:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb6ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295389:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1e1 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295403:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1e1 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.295417:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ff541a1800) 00010000:00010000:3.0:1787848374.295420:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848374.295422:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff444c6400, rc 0) 00000100:00100000:3.0:1787848374.295548:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:9701:x1874694611424384:12345-192.168.201.26@tcp:101:rm.0 Request processed in 770us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848374.295555:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:1.0:1787848374.306104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848374.306188:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611424640 00000100:00100000:3.0:1787848374.306198:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611424640 00000100:00100000:3.0:1787848374.306255:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:3.0:1787848374.306267:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:9701:x1874694611424640:12345-192.168.201.26@tcp:36:rm.0 00010000:00010000:3.0:1787848374.306337:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787848374.306368:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6400/0x9aeb41e0543cb6f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1e1 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.306392:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb6a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1c5 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.306407:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ff541a1800) 00010000:00010000:3.0:1787848374.306438:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cb6b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1cc expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.306449:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:3.0:1787848374.306452:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848374.306474:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.306506:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.306527:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.306545:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb703 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.306551:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb703 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.306558:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb703 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.306735:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb70a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.306743:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb70a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.306750:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb70a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787848374.307527:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787848374.307540:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323218898917ns, next at 324218896306ns, rc = 0 00010000:00010000:3.0:1787848374.307615:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236000/0x9aeb41e0543cb711 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307626:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236000/0x9aeb41e0543cb711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307678:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236000/0x9aeb41e0543cb711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307685:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236000/0x9aeb41e0543cb711 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307692:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236000/0x9aeb41e0543cb711 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307699:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236000/0x9aeb41e0543cb711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307725:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787848374.307748:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb70a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307754:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb70a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307759:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb70a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307764:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c6c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848374.307768:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb70a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307775:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb70a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307786:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ff541a1d00) 00010000:00010000:3.0:1787848374.307789:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787848374.307801:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb70a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307807:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6c00/0x9aeb41e0543cb70a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307824:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307830:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307836:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307841:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c6000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848374.307844:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307850:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307857:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:3.0:1787848374.307860:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848374.307862:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.307868:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6000/0x9aeb41e0543cb6fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787848374.307878:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f61b0ab reply state 00000000f0c68e72 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb703 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848374.307897:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787848374.307978:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:9701:x1874694611424640:12345-192.168.201.26@tcp:36:rm.0 Request processed in 1712us (1883us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787848374.307987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 30 00010000:00010000:3.0:1787848374.308032:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848374.308039:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236000/0x9aeb41e0543cb711 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.308045:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848374.308048:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236000/0x9aeb41e0543cb711 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.308053:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236000/0x9aeb41e0543cb711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.308063:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ff541a1d00) 00010000:00010000:3.0:1787848374.308065:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787848374.308067:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236000/0x9aeb41e0543cb711 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.308072:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236000/0x9aeb41e0543cb711 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.308085:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848374.308087:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848374.308089:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848374.319925:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848374.321291:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb703 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.321319:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb703 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.321326:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb703 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.321332:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff444c7c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848374.321338:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb703 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.321346:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb703 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.321362:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff93ff541a1700) 00010000:00010000:2.0:1787848374.321365:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848374.321383:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb703 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.321390:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7c00/0x9aeb41e0543cb703 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848374.323039:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848374.323139:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611424896 00000100:00100000:0.0:1787848374.323149:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611424896 00000100:00100000:0.0:1787848374.323211:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:0.0:1787848374.323224:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:9701:x1874694611424896:12345-192.168.201.26@tcp:35:rm.0 00000100:00100000:0.0:1787848374.323949:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:9701:x1874694611424896:12345-192.168.201.26@tcp:35:rm.0 Request processed in 726us (918us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787848374.323958:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:0.0:1787848374.338226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848374.338359:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611425152 00000100:00100000:2.0:1787848374.338372:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611425152 00000100:00100000:2.0:1787848374.338457:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:2.0:1787848374.338468:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:9701:x1874694611425152:12345-192.168.201.26@tcp:36:rm.0 00010000:00010000:2.0:1787848374.338544:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787848374.338576:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c7e00/0x9aeb41e0543cb6d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1da expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.338605:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6e00/0x9aeb41e0543cb670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1b7 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.338616:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:2.0:1787848374.338634:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff444c6800/0x9aeb41e0543cb631 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1a9 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.338691:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1300) 00010000:00010000:2.0:1787848374.338697:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848374.338725:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb718 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.338737:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb718 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.338745:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb718 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.338772:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb71f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.338779:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb71f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.338784:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb71f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.339158:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb726 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.339168:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb726 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848374.339174:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb726 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848374.340253:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787848374.340279:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb726 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340288:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb726 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340296:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb726 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340302:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848374.340306:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb726 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340314:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb726 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340326:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ff53a89600) 00010000:00010000:1.0:1787848374.340337:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787848374.340342:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb726 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340348:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb726 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340371:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb718 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340377:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb718 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340383:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb718 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340387:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665e00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848374.340390:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb718 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340396:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb718 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340403:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff53a89e00) 00010000:00010000:1.0:1787848374.340406:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848374.340409:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb718 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848374.340558:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb718 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787848374.340571:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7a71aa2 reply state 0000000082104f4c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb71f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848374.340590:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787848374.340830:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:9701:x1874694611425152:12345-192.168.201.26@tcp:36:rm.0 Request processed in 2362us (2615us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787848374.340839:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 31 00010000:00010000:3.0:1787848374.344613:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb71f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.344636:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb71f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.344862:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb71f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.344868:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848374.344873:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb71f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.344880:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb71f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.344898:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93ff53a89500) 00010000:00010000:3.0:1787848374.344901:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848374.344906:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb71f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848374.344914:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb71f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848374.982666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848374.982842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848374.982884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848374.982932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848374.983580:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611425408 00000100:00100000:2.0:1787848374.983594:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611425408 00000100:00100000:2.0:1787848374.983684:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611425664 00000100:00100000:2.0:1787848374.983688:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611425664 00000100:00100000:2.0:1787848374.983728:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:2.0:1787848374.983739:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f4303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:2354:x1874694611425408:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848374.983828:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f4303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:2354:x1874694611425408:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 91us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848374.983837:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:2.0:1787848374.983856:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00100000:2.0:1787848374.983863:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f433c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611425664:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848374.983904:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f433c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611425664:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 41us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848374.983911:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00080000:2.0:1787848374.983931:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848374.985247:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611425536 00000100:00100000:3.0:1787848374.985258:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611425536 00000100:00100000:3.0:1787848374.985390:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:3.0:1787848374.985401:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f430b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2354:x1874694611425536:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848374.985475:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f430b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2354:x1874694611425536:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 76us (2633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848374.985484:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:1.0:1787848374.989709:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611425280 00000100:00100000:1.0:1787848374.989731:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611425280 00000100:00100000:1.0:1787848374.989832:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 258 00000100:00100000:1.0:1787848374.989847:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611425280:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848374.989969:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611425280:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 126us (7337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848374.989989:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 258 00010000:00010000:3.0:1787848375.345393:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848376.367851:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848377.392605:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848377.727394:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787848377.727441:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631385472:0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.727547:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848377.727628:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631385472 00000100:00100000:0.0:1787848377.727676:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631385472 00000100:00100000:0.0:1787848377.727757:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787848377.727768:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631385472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.727828:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631385472:12345-0@lo:400:kworker.0 Request processed in 62us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848377.727836:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787848377.728207:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631385472:0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.728295:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631385600:0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.728345:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848377.728397:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631385600 00000100:00100000:0.0:1787848377.728401:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631385600 00000100:00100000:0.0:1787848377.728434:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787848377.728441:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f4321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631385600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.728481:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f4321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631385600:12345-0@lo:400:kworker.0 Request processed in 40us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848377.728487:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787848377.728519:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631385600:0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.728551:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631385728:0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.728576:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848377.728605:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631385728 00000100:00100000:0.0:1787848377.728608:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631385728 00000100:00100000:0.0:1787848377.728685:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787848377.728691:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631385728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.728733:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631385728:12345-0@lo:400:kworker.0 Request processed in 42us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848377.728738:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1787848377.728755:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848377.728776:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631385728:0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.728810:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631385856:0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.728858:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848377.728889:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631385856 00000100:00100000:0.0:1787848377.728892:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631385856 00000100:00100000:0.0:1787848377.728928:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787848377.728948:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f431680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631385856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.728985:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f431680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631385856:12345-0@lo:400:kworker.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848377.728991:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787848377.729009:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787848377.729027:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5f430000 x1874694631385856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848377.729037:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631385856:0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.729064:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787848377.729070:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631385984:0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.729091:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848377.729114:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631385984 00000100:00100000:0.0:1787848377.729118:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631385984 00000100:00100000:0.0:1787848377.729144:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787848377.729150:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f432d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631385984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.729190:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f432d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631385984:12345-0@lo:400:kworker.0 Request processed in 40us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848377.729196:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1787848377.729209:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848377.729225:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631385984:0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.729254:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631386112:0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.729277:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848377.729306:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631386112 00000100:00100000:0.0:1787848377.729310:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631386112 00000100:00100000:0.0:1787848377.729338:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787848377.729344:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f433840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631386112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848377.729380:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f433840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631386112:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848377.729387:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787848377.729401:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787848377.729416:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5f430000 x1874694631386112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848377.729425:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631386112:0@lo:400:kworker.0 00000004:00080000:2.0:1787848378.223878:0:7937:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327135234249ns, next at 328135231299ns, rc = 0 00000100:00100000:1.0:1787848378.224029:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631386240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848378.224116:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848378.224230:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631386240 00000100:00100000:2.0:1787848378.224249:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631386240 00000100:00100000:2.0:1787848378.224316:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787848378.224326:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631386240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848378.224365:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848378.224412:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631386240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848378.224419:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787848378.224551:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e21c0 x1874694631386240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848378.224580:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631386240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848378.225513:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848378.225531:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631386368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848378.225592:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848378.225727:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631386368 00000100:00100000:2.0:1787848378.225734:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631386368 00000100:00100000:2.0:1787848378.225770:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787848378.225778:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631386368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848378.225805:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848378.225888:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631386368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848378.225895:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1787848378.228967:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e21c0 x1874694631386368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848378.228996:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631386368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787848378.415867:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787848379.332269:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1787848379.332296:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787848379.332329:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1787848379.332343:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787848379.332899:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631386496:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787848379.332991:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848379.333188:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631386496 00000100:00100000:2.0:1787848379.333196:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631386496 00000100:00100000:2.0:1787848379.333263:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787848379.333273:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631386496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787848379.333299:0:11455:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787848379.333336:0:11455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9066b6, atime: 0x6a9066b6, ctime: 0x6a9066b6, blocks: 0x1 00010000:00010000:2.0:1787848379.333344:0:11455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cb72d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848379.333362:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1787848379.333368:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848379.333387:0:11455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cb72d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848379.333408:0:11455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cb72d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848379.333418:0:11455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cb72d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848379.333426:0:11455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cb72d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848379.333524:0:11455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1787848379.333562:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787848379.333606:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848379.333614:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cb72d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848379.333623:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848379.333627:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cb72d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848379.333655:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cb72d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848379.333676:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cb72d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848379.333793:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cb72d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848379.333817:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848379.333819:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848379.333821:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848379.336586:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631386496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3308us (3588us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787848379.336600:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1787848379.337363:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff79648000/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787848379.337374:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631386496:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787848379.439787:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848380.123053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848380.123090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848380.129150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848380.131749:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611425792 00000100:00100000:2.0:1787848380.131763:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611425792 00000100:00100000:2.0:1787848380.131817:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 260 00000100:00100000:2.0:1787848380.131827:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611425792:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848380.131941:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611425792:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 115us (8901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848380.131948:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 260 00000100:00100000:2.0:1787848380.132105:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611426048 00000100:00100000:2.0:1787848380.132109:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611426048 00000100:00100000:2.0:1787848380.132148:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00100000:2.0:1787848380.132155:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79648b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611426048:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848380.132191:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79648b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611426048:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 37us (9100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848380.132198:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00080000:2.0:1787848380.132214:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787848380.132382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848380.156067:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611425920 00000100:00100000:1.0:1787848380.156086:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611425920 00000100:00080000:1.0:1787848380.156173:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848380.156274:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611426176 00000100:00100000:1.0:1787848380.156278:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611426176 00000100:00100000:1.0:1787848380.156320:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:1.0:1787848380.156332:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611425920:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848380.156466:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611425920:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 137us (27326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848380.156475:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:1.0:1787848380.156493:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 127 00000100:00100000:1.0:1787848380.156501:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611426176:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848380.156526:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611426176:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 27us (24145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848380.156532:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 127 00000100:00080000:1.0:1787848380.156562:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787848380.313073:0:11637:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787848380.467319:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848381.487814:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787848382.059712:0:11685:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdca11e370 20000000:00000080:0.0:1787848382.059734:0:11685:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ff7fb6b000 uarg=0000000000000000 20000000:01000000:0.0:1787848382.059772:0:11685:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787848382.059778:0:11685:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787848382.059783:0:11685:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787848382.064066:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787848382.064257:0:11685:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787848382.073720:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787848382.073784:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787848382.073878:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787848382.073905:0:11685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787848382.073935:0:11685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.073963:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff5f42fe00/0x9aeb41e0543cb5cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb194 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.073973:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff444c6600/0x9aeb41e0543cb5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb19b expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.073982:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff40030400/0x9aeb41e0543cb5e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb5dd expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.073989:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff444c7400/0x9aeb41e0543cb5f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb5eb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.073997:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff50664200/0x9aeb41e0543cb600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb5f9 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.074006:0:11685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.074076:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff50664200/0x9aeb41e0543cb600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb5f9 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.074093:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff50664200/0x9aeb41e0543cb600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5f9 expref: 18 pid: 5837 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848382.074108:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f432580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874694631386624:0@lo:104: 00000100:00100000:0.0:1787848382.074371:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787848382.074450:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff444c7400/0x9aeb41e0543cb5f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb5eb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.074458:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff444c7400/0x9aeb41e0543cb5f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5eb expref: 18 pid: 5835 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848382.074466:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f431e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874694631386752:0@lo:104: 00000100:00100000:0.0:1787848382.074487:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787848382.074518:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff40030400/0x9aeb41e0543cb5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cb5dd expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.074526:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ff40030400/0x9aeb41e0543cb5e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5dd expref: 18 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848382.074534:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f4330c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874694631386880:0@lo:104: 00000100:00100000:0.0:1787848382.074555:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787848382.074571:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff444c6600/0x9aeb41e0543cb5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb19b expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.074581:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff444c6600/0x9aeb41e0543cb5d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb19b expref: 12 pid: 5835 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848382.074602:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f432940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874694631387008:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848382.074692:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff5f42fe00/0x9aeb41e0543cb5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb194 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.074700:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff5f42fe00/0x9aeb41e0543cb5cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb194 expref: 12 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848382.074708:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f433480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874694631387136:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848382.074731:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fbe10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848382.079735:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787848382.079797:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631386624 00000100:00100000:3.0:1787848382.079809:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631386624 00000100:00100000:3.0:1787848382.079989:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631386752 00000100:00100000:3.0:1787848382.079994:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631386752 00000100:00100000:3.0:1787848382.080005:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631386880 00000100:00100000:3.0:1787848382.080008:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631386880 00000100:00100000:3.0:1787848382.080026:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787848382.080037:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f4312c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:11685:x1874694631386624:12345-0@lo:104: 00010000:00010000:3.0:1787848382.080057:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080173:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787848382.080181:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f4312c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+5:11685:x1874694631386624:12345-0@lo:104: Request processed in 146us (5811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848382.080189:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787848382.080211:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787848382.080218:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f431a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+4:11685:x1874694631386752:12345-0@lo:104: 00010000:00010000:3.0:1787848382.080227:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080262:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787848382.080267:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f431a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+4:11685:x1874694631386752:12345-0@lo:104: Request processed in 51us (5779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848382.080277:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f432580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874694631386624:0@lo:104: 00000100:00100000:3.0:1787848382.080286:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787848382.080287:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f431e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874694631386752:0@lo:104: 00000100:00100000:3.0:1787848382.080298:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787848382.080304:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7938bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:11685:x1874694631386880:12345-0@lo:104: 00010000:00010000:3.0:1787848382.080312:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080355:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787848382.080360:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7938bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+3:11685:x1874694631386880:12345-0@lo:104: Request processed in 57us (5805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848382.080367:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787848382.080414:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787848382.080421:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080428:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664000 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848382.080434:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080443:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848382.080446:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f4330c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874694631386880:0@lo:104: 10000000:00010000:3.0:1787848382.080452:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848382.080458:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f432940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874694631387008:192.168.201.26@tcp:104: 10000000:01000000:3.0:1787848382.080459:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787848382.080511:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080518:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848382.080558:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080566:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cb5f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080578:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787848382.080581:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080587:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848382.080590:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080596:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848382.080602:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848382.080606:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787848382.080627:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080633:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787848382.080684:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7964ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631387264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848382.080694:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080701:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff50664a00/0x9aeb41e0543cb5eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb5f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080708:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848382.080716:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080722:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e000 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848382.080725:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080731:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848382.080733:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1787848382.080737:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848382.080743:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787848382.080756:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080762:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787848382.080770:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787848382.080776:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631387392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848382.080777:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080783:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cb5dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cb5e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080797:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848382.080799:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848382.080801:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848382.080808:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848382.080808:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848382.080819:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631387264 00000100:00100000:3.0:1787848382.080824:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631387264 00010000:00010000:3.0:1787848382.080844:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff50664200/0x9aeb41e0543cb600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5f9 expref: 19 pid: 5837 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848382.080895:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631387392 00000100:00100000:3.0:1787848382.080899:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631387392 00010000:00010000:3.0:1787848382.080913:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff444c7400/0x9aeb41e0543cb5f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5eb expref: 20 pid: 5835 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848382.080932:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787848382.080938:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f4312c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+20:3310:x1874694631387264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848382.080949:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848382.080955:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff50664200/0x9aeb41e0543cb600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5f9 expref: 20 pid: 5837 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080968:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff50664200/0x9aeb41e0543cb600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5f9 expref: 20 pid: 5837 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848382.080968:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787848382.080977:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f431a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+20:3310:x1874694631387392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848382.080983:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff50664200/0x9aeb41e0543cb600 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb5f9 expref: 20 pid: 5837 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.080984:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848382.080989:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff444c7400/0x9aeb41e0543cb5f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5eb expref: 20 pid: 5835 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.080995:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787848382.081007:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff444c7400/0x9aeb41e0543cb5f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5eb expref: 19 pid: 5835 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.081017:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c7400/0x9aeb41e0543cb5f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb5eb expref: 19 pid: 5835 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848382.081022:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f4312c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631387264:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (290us total) trans 0 rc 0/0 00010000:00010000:0.0:1787848382.081026:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848382.081029:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787848382.081046:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f431a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:3310:x1874694631387392:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848382.081049:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631387520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848382.081052:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787848382.081075:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848382.081114:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631387520 00000100:00100000:3.0:1787848382.081118:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631387520 00010000:00010000:3.0:1787848382.081133:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff40030400/0x9aeb41e0543cb5e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5dd expref: 17 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848382.081175:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787848382.081182:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff50bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:3312:x1874694631387520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848382.081189:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848382.081193:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff40030400/0x9aeb41e0543cb5e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5dd expref: 17 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.081203:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff40030400/0x9aeb41e0543cb5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cb5dd expref: 17 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.081213:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40030400/0x9aeb41e0543cb5e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cb5dd expref: 17 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.081222:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848382.081258:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff50bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3312:x1874694631387520:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848382.081264:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787848382.081284:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631387520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787848382.081314:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631387392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787848382.081321:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7964ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631387264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787848382.091065:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848382.091118:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848382.091403:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611426432 00000100:00100000:2.0:1787848382.091412:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611426432 00010000:00010000:2.0:1787848382.091457:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff5f42fe00/0x9aeb41e0543cb5cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb194 expref: 13 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848382.091493:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611426304 00000100:00100000:2.0:1787848382.091496:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611426304 00010000:00010000:2.0:1787848382.091507:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff444c6600/0x9aeb41e0543cb5d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb19b expref: 14 pid: 5835 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848382.091529:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:2.0:1787848382.091537:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+14:2351:x1874694611426432:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848382.091553:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848382.091559:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff93ff5f42fe00/0x9aeb41e0543cb5cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb194 expref: 14 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848382.091585:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff5f42fe00/0x9aeb41e0543cb5cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb194 expref: 14 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848382.091606:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848382.091623:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:3.0:1787848382.091633:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+14:2351:x1874694611426304:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848382.091662:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848382.091667:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff93ff444c6600/0x9aeb41e0543cb5d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb19b expref: 14 pid: 5835 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.091676:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff444c6600/0x9aeb41e0543cb5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb19b expref: 14 pid: 5835 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848382.091683:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+14:2351:x1874694611426432:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 146us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848382.091692:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 33 00010000:00010000:3.0:1787848382.091694:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c6600/0x9aeb41e0543cb5d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb19b expref: 14 pid: 5835 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.091708:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.091717:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.091735:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.091741:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.091748:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.091755:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.091761:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848382.091765:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.091772:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.091780:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848382.091813:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787848382.092223:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff5f42fe00/0x9aeb41e0543cb5cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb194 expref: 12 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848382.092402:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f433480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874694631387136:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848382.092442:0:11685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.092451:0:11685:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.092457:0:11685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848382.092463:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb734 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848382.092785:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:2351:x1874694611426304:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 1152us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848382.092801:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 34 00010000:00010000:3.0:1787848382.512569:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848382.832273:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631387904:0@lo:400:kworker.0 00000100:00100000:1.0:1787848382.832358:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848382.832429:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787848382.832437:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631387776:0@lo:400:kworker.0 00000100:00100000:1.0:1787848382.832463:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848382.832482:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631388288:0@lo:400:kworker.0 00000100:00100000:1.0:1787848382.832523:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848382.832559:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631387904 00000100:00100000:1.0:1787848382.832565:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631387904 00000100:00100000:1.0:1787848382.832610:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631387776 00000100:00100000:1.0:1787848382.832612:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631387776 00000100:00100000:1.0:1787848382.832670:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787848382.832679:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631387904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848382.832730:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631387904:12345-0@lo:400:kworker.0 Request processed in 52us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848382.832737:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787848382.832754:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787848382.832760:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631387776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848382.833189:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631387648:0@lo:400:kworker.0 00000100:00100000:3.0:1787848382.833229:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848382.833256:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631388160:0@lo:400:kworker.0 00000100:00100000:3.0:1787848382.833279:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848382.833298:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848382.833303:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631388032:0@lo:400:kworker.0 00000100:00100000:3.0:1787848382.833325:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848382.833374:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631388160 00000100:00100000:3.0:1787848382.833378:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631388160 00000100:00100000:3.0:1787848382.833403:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787848382.833410:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631388160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848382.833449:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631388160:12345-0@lo:400:kworker.0 Request processed in 38us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848382.833456:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1787848382.833472:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848382.833484:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631388288 00000100:00100000:3.0:1787848382.833488:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631388288 00000100:00100000:3.0:1787848382.833533:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631388032 00000100:00100000:3.0:1787848382.833536:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631388032 00000100:00100000:3.0:1787848382.833552:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787848382.833557:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79249680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874694631388288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848382.833588:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79249680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874694631388288:12345-0@lo:400:kworker.0 Request processed in 31us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848382.833594:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787848382.833615:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787848382.833622:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631388032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848382.833670:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631388032:12345-0@lo:400:kworker.0 Request processed in 50us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848382.833676:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787848382.833691:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848382.833693:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787848382.833716:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff79249a40 x1874694631388032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848382.833731:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631388032:0@lo:400:kworker.0 00000100:00100000:3.0:1787848382.833742:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631388160:0@lo:400:kworker.0 00000100:00100000:3.0:1787848382.833804:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631388288:0@lo:400:kworker.0 00000100:00100000:3.0:1787848382.833816:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631387904:0@lo:400:kworker.0 00000100:00100000:0.0:1787848382.834069:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631387648 00000100:00100000:0.0:1787848382.834073:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631387648 00000100:00100000:0.0:1787848382.834113:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787848382.834127:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3313:x1874694631387648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848382.834181:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3313:x1874694631387648:12345-0@lo:400:kworker.0 Request processed in 55us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848382.834188:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787848382.834225:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631387648:0@lo:400:kworker.0 00000100:00100000:1.0:1787848382.835618:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631387776:12345-0@lo:400:kworker.0 Request processed in 2851us (3147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848382.835629:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787848382.836284:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631387776:0@lo:400:kworker.0 00000100:00100000:0.0:1787848383.347232:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787848383.347264:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631388416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848383.347347:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848383.348897:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848383.348920:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631388544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848383.348984:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848383.350007:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631388416 00000100:00100000:1.0:1787848383.350017:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631388416 00000100:00100000:1.0:1787848383.350101:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631388544 00000100:00100000:1.0:1787848383.350106:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631388544 00000100:00100000:1.0:1787848383.350137:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787848383.350147:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f430780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631388416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787848383.350189:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848383.350273:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f430780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631388416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (2927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848383.350282:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787848383.350297:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787848383.350303:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631388544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848383.350321:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848383.350353:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631388544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848383.350359:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787848383.350416:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb4a580 x1874694631388544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848383.350447:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631388544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848383.350965:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631388416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787848383.535877:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787848383.919812:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787848383.919820:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93fe41342800 from 7 10000000:01000000:3.0:1787848383.919837:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787848383.919888:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848383.919901:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848383.919911:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848383.919939:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631388672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787848383.920048:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848383.920130:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f4d8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787848383.920277:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631388672 00000100:00100000:0.0:1787848383.920285:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631388672 00000100:00100000:0.0:1787848383.920345:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787848383.920355:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:5839:x1874694631388672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787848383.920369:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848383.920383:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb742 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb73b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848383.920409:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb73b expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848383.920420:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb73b expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848383.920430:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40031c00, rc 0) 00000100:00100000:0.0:1787848383.920501:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631388672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848383.920508:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787848383.920732:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631388672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848383.920748:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848383.920757:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848383.920812:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631388800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787848383.920853:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848383.920873:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f4d8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787848383.921373:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631388800 00000100:00100000:0.0:1787848383.921379:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631388800 00000100:00100000:0.0:1787848383.921414:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787848383.921423:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631388800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848383.921735:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631388800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848383.921742:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787848383.922012:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631388800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787848383.922051:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631388928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787848383.922093:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848383.922145:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f4d8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848383.922302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631388928 00000100:00100000:1.0:1787848383.922308:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631388928 00000100:00100000:1.0:1787848383.922341:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787848383.922350:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631388928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848383.922536:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631388928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848383.922543:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787848383.924705:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631388928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787848383.926869:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f432940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11698:1874694631389056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848383.926973:0:11698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848383.927012:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6ece2480 going to sleep for 11 seconds 00000100:00100000:1.0:1787848383.927362:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631389056 00000100:00100000:1.0:1787848383.927371:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631389056 00000100:00100000:1.0:1787848383.927430:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787848383.927440:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:11698:x1874694631389056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848383.930908:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:11698:x1874694631389056:12345-0@lo:502:llog_process_th.0 Request processed in 3459us (3924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848383.930923:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787848383.931923:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f432940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11698:1874694631389056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787848383.931976:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787848383.931989:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848383.931992:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787848383.931998:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93fe41342800 00000020:00000080:1.0:1787848383.932001:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787848383.932151:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792492c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11698:1874694631389184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848383.932216:0:11698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848383.932267:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff45721480 going to sleep for 11 seconds 00000100:00100000:0.0:1787848383.932456:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631389184 00000100:00100000:0.0:1787848383.932463:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631389184 00000100:00100000:0.0:1787848383.932515:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787848383.932524:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:11698:x1874694631389184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848383.932761:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:11698:x1874694631389184:12345-0@lo:502:llog_process_th.0 Request processed in 238us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848383.932769:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787848383.932994:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792492c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11698:1874694631389184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787848383.933023:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848383.933029:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848383.933031:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787848383.933036:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787848383.934166:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787848383.934193:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787848383.934204:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848383.934227:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848383.934238:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787848383.934241:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff4314e000 from 7 10000000:01000000:0.0:1787848383.934244:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787848383.934277:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848383.934285:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848383.934293:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848383.934315:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f4330c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631389312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787848383.934377:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848383.934426:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8029dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848383.934888:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631389312 00000100:00100000:2.0:1787848383.934896:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631389312 00000100:00100000:2.0:1787848383.934938:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787848383.934948:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:5839:x1874694631389312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848383.934960:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848383.934974:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50664600/0x9aeb41e0543cb750 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb749 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848383.934998:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50664600/0x9aeb41e0543cb750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb749 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848383.935022:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50664600/0x9aeb41e0543cb750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb749 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848383.935045:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664600, rc 0) 00000100:00100000:2.0:1787848383.935105:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631389312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848383.935122:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787848383.935315:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f4330c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631389312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848383.935331:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848383.935349:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848383.935412:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631389440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848383.935458:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848383.935489:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff45721c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787848383.936902:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631389440 00000100:00100000:2.0:1787848383.936913:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631389440 00000100:00100000:2.0:1787848383.936955:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787848383.936963:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631389440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848383.937442:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631389440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 478us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848383.938699:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787848383.938776:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631389440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848383.938844:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631389568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848383.938911:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848383.938948:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848383.938964:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631389568 00000100:00100000:2.0:1787848383.938970:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631389568 00000100:00100000:2.0:1787848383.939004:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787848383.939012:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631389568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848383.944904:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631389568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5883us (5984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848383.944919:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787848383.945206:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631389568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848383.948994:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11699:1874694631389696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848383.949088:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848383.949130:0:11699:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff45721480 going to sleep for 11 seconds 00000100:00100000:0.0:1787848383.949565:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631389696 00000100:00100000:0.0:1787848383.949582:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631389696 00000100:00100000:0.0:1787848383.949665:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787848383.949677:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:11699:x1874694631389696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848383.949914:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:11699:x1874694631389696:12345-0@lo:502:llog_process_th.0 Request processed in 239us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848383.949923:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787848383.950869:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11699:1874694631389696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787848383.950914:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787848383.950925:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787848383.950927:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787848383.950933:0:11699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ff4314e000 00000020:00000080:1.0:1787848383.950936:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787848383.951012:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11699:1874694631389824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848383.954006:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848383.954073:0:11699:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff45721480 going to sleep for 11 seconds 00000100:00100000:0.0:1787848383.954933:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631389824 00000100:00100000:0.0:1787848383.954944:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631389824 00000100:00100000:0.0:1787848383.955011:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787848383.955046:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:11699:x1874694631389824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848383.955503:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:11699:x1874694631389824:12345-0@lo:502:llog_process_th.0 Request processed in 458us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848383.955510:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787848383.963241:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11699:1874694631389824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787848383.968623:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848383.968635:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848383.968656:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787848383.968662:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787848383.968861:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787848383.968879:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787848383.968890:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848383.968901:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848383.968912:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787848383.968920:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff506b3000 from 7 10000000:01000000:3.0:1787848383.968922:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787848383.968958:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848383.968966:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848383.968977:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848383.969000:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631389952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787848383.969077:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848383.969123:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f4d8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787848383.969343:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631389952 00000100:00100000:0.0:1787848383.969350:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631389952 00000100:00100000:0.0:1787848383.969401:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787848383.969411:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:5839:x1874694631389952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787848383.969425:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848383.969451:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb75e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cb757 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848383.969476:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb75e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cb757 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848383.969485:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb75e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cb757 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848383.969492:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030600, rc 0) 00000100:00100000:0.0:1787848383.969536:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631389952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848383.969543:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787848383.969875:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631389952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787848383.969891:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848383.969907:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848383.969963:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f431e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631390080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848383.969991:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848383.970014:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8029db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787848383.970267:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631390080 00000100:00100000:1.0:1787848383.970273:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631390080 00000100:00100000:1.0:1787848383.970733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787848383.970744:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631390080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848383.972775:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631390080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2027us (2775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848383.972794:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787848383.991903:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f431e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631390080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848383.991974:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631390208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848383.992057:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848383.992095:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848383.992344:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631390208 00000100:00100000:3.0:1787848383.992351:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631390208 00000100:00100000:3.0:1787848383.992412:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787848383.992423:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631390208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787848383.992663:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:5839:x1874694631390208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848383.992671:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787848383.992915:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:5839:1874694631390208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848384.004369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848384.004597:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611426560 00000100:00100000:3.0:1787848384.004608:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611426560 00000100:00100000:3.0:1787848384.004696:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 275 00000100:00100000:3.0:1787848384.004708:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:5596:x1874694611426560:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848384.004726:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848384.004747:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cb765 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1e8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848384.004795:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cb765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1e8 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848384.004807:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cb765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1e8 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848384.004817:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237200, rc 0) 00000100:00100000:3.0:1787848384.004884:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611426560:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 179us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848384.004892:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 275 00000100:00100000:2.0:1787848384.008939:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11702:1874694631390336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848384.009038:0:11702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848384.009080:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787848384.009473:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631390336 00000100:00100000:1.0:1787848384.009482:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631390336 00000100:00100000:1.0:1787848384.009559:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787848384.009587:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:11702:x1874694631390336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848384.009857:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:11702:x1874694631390336:12345-0@lo:502:llog_process_th.0 Request processed in 272us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848384.009865:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787848384.010889:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb492c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11702:1874694631390336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787848384.010932:0:11702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787848384.010942:0:11702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848384.010945:0:11702:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787848384.010952:0:11702:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ff506b3000 00000020:00000080:3.0:1787848384.010956:0:11702:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787848384.011349:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11702:1874694631390464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848384.011410:0:11702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848384.011961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848384.012000:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631390464 00000100:00100000:1.0:1787848384.012007:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631390464 00000100:00100000:1.0:1787848384.012055:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611426688 00000100:00100000:1.0:1787848384.012057:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611426688 00000100:00100000:1.0:1787848384.012072:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787848384.012079:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:11702:x1874694631390464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848384.012662:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff43a4b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787848384.012714:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 278 00000100:00100000:2.0:1787848384.012727:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611426688:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848384.013029:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611426688:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 305us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848384.013037:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 278 00000100:00100000:1.0:1787848384.013405:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:11702:x1874694631390464:12345-0@lo:502:llog_process_th.0 Request processed in 1324us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848384.013413:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787848384.016352:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:11702:1874694631390464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787848384.016406:0:11702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848384.016415:0:11702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848384.016418:0:11702:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787848384.016422:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787848384.017725:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787848384.017769:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787848384.017792:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848384.017817:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848384.019050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848384.019242:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611426816 00000100:00100000:2.0:1787848384.019252:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611426816 00000100:00100000:2.0:1787848384.019305:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 279 00000100:00100000:2.0:1787848384.019316:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611426816:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787848384.019806:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787848384.021318:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611426816:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 1994us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848384.021331:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 279 00000100:00100000:1.0:1787848384.026170:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848384.026265:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611426944 00000100:00100000:2.0:1787848384.026276:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611426944 00000100:00100000:2.0:1787848384.026332:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 280 00000100:00100000:2.0:1787848384.026343:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:9972:x1874694611426944:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787848384.026626:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:9972:x1874694611426944:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 283us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848384.026635:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 280 00000100:00100000:1.0:1787848384.035913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848384.036019:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611427072 00000100:00100000:2.0:1787848384.036031:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611427072 00000100:00100000:2.0:1787848384.036092:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 281 00000100:00100000:2.0:1787848384.036102:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:9972:x1874694611427072:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787848384.036356:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:9972:x1874694611427072:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 255us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848384.036372:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 281 00000100:00100000:0.0:1787848384.051835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848384.052095:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611427200 00000100:00100000:3.0:1787848384.052106:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611427200 00000100:00100000:3.0:1787848384.052181:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 282 00000100:00100000:3.0:1787848384.052190:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:5596:x1874694611427200:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848384.052207:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848384.052225:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79237600/0x9aeb41e0543cb76c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848384.052255:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79237600/0x9aeb41e0543cb76c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1ef expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848384.052281:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79237600/0x9aeb41e0543cb76c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1ef expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848384.052290:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237600, rc 0) 00000100:00100000:3.0:1787848384.052345:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:5596:x1874694611427200:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 156us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848384.052353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 282 00000100:00100000:3.0:1787848384.061216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848384.061262:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611427328 00000100:00100000:3.0:1787848384.061271:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611427328 00000100:00100000:3.0:1787848384.061323:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 283 00000100:00100000:3.0:1787848384.061333:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:5596:x1874694611427328:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787848384.061678:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:5596:x1874694611427328:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 345us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848384.061689:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 283 00000100:00100000:0.0:1787848384.074288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848384.074385:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611427456 00000100:00100000:3.0:1787848384.074396:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611427456 00000100:00100000:3.0:1787848384.074461:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 284 00000100:00100000:3.0:1787848384.074472:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:5596:x1874694611427456:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787848384.074725:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:5596:x1874694611427456:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 254us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848384.074734:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 284 00000100:00100000:0.0:1787848384.079932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848384.086003:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611427584 00000100:00100000:1.0:1787848384.086017:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611427584 00000100:00100000:0.0:1787848384.086191:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 285 00000100:00100000:0.0:1787848384.086202:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:9975:x1874694611427584:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787848384.086606:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:9975:x1874694611427584:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 404us (6682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848384.086615:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 285 00000100:00100000:1.0:1787848384.093511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848384.094882:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611427712 00000100:00100000:0.0:1787848384.094896:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611427712 00000100:00100000:0.0:1787848384.095003:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 286 00000100:00100000:0.0:1787848384.095015:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:9975:x1874694611427712:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787848384.095280:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:9975:x1874694611427712:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 267us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848384.095288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 286 00000001:00080000:1.0:1787848384.438280:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1787848384.560303:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787848385.074259:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787848385.219494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848385.219538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848385.219631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848385.219702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848385.219735:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611428096 00000100:00100000:1.0:1787848385.219755:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611428096 00000100:00100000:1.0:1787848385.220262:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00100000:1.0:1787848385.220273:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79249a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2354:x1874694611428096:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848385.220408:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79249a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2354:x1874694611428096:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 136us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848385.220416:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00080000:1.0:1787848385.220437:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787848385.221099:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611427968 00000100:00100000:3.0:1787848385.221107:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611427968 00000100:00100000:3.0:1787848385.221174:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611428224 00000100:00100000:3.0:1787848385.221177:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611428224 00000100:00100000:3.0:1787848385.221199:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 131 00000100:00100000:3.0:1787848385.221207:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611427968:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848385.221249:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611427968:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 43us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848385.221254:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 131 00000100:00100000:3.0:1787848385.221268:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 132 00000100:00100000:3.0:1787848385.221274:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2353:x1874694611428224:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848385.221298:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2353:x1874694611428224:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 25us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848385.221304:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 132 00000100:00080000:1.0:1787848385.221606:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848385.226823:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611427840 00000100:00100000:0.0:1787848385.226840:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611427840 00000100:00100000:0.0:1787848385.226936:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 287 00000100:00100000:0.0:1787848385.226947:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611427840:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848385.227049:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611427840:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 103us (7510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848385.227056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 287 00010000:00010000:3.0:1787848385.588042:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848386.611797:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848387.631972:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848387.952518:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff796483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631390848:0@lo:400:kworker.0 00000100:00100000:3.0:1787848387.952599:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848387.952689:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787848387.952696:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631390720:0@lo:400:kworker.0 00000100:00100000:3.0:1787848387.952720:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848387.952738:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631391232:0@lo:400:kworker.0 00000100:00100000:3.0:1787848387.952775:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848387.952820:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631390848 00000100:00100000:3.0:1787848387.952828:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631390848 00000100:00100000:3.0:1787848387.952890:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631390720 00000100:00100000:3.0:1787848387.952894:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631390720 00000100:00100000:3.0:1787848387.952939:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787848387.952948:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631390848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848387.952975:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631391232 00000100:00100000:3.0:1787848387.953005:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631390848:12345-0@lo:400:kworker.0 Request processed in 57us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848387.953013:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787848387.953025:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631391232 00000100:00100000:3.0:1787848387.953031:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787848387.953040:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631390720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848387.953066:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787848387.953076:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631391232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848387.953092:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631390720:12345-0@lo:400:kworker.0 Request processed in 53us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848387.953100:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787848387.953124:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631391232:12345-0@lo:400:kworker.0 Request processed in 50us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848387.953133:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787848387.953151:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631390720:0@lo:400:kworker.0 00000100:00080000:0.0:1787848387.953169:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787848387.953175:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848387.953429:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787848387.953436:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff79648000, transno 4294967300 00000100:00100000:3.0:1787848387.953459:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631391232:0@lo:400:kworker.0 00000100:00100000:3.0:1787848387.953474:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff796483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631390848:0@lo:400:kworker.0 00000100:00100000:1.0:1787848387.953849:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631390592:0@lo:400:kworker.0 00000100:00100000:1.0:1787848387.953906:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848387.953948:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7964b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631391104:0@lo:400:kworker.0 00000100:00100000:1.0:1787848387.953972:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848387.953994:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787848387.954001:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7964ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631390976:0@lo:400:kworker.0 00000100:00100000:1.0:1787848387.954023:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848387.954051:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631391104 00000100:00100000:1.0:1787848387.954055:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631391104 00000100:00100000:1.0:1787848387.954110:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787848387.954118:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79249e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631391104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848387.954581:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79249e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631391104:12345-0@lo:400:kworker.0 Request processed in 461us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848387.954589:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1787848387.954619:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848387.954678:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7964b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631391104:0@lo:400:kworker.0 00000100:00100000:1.0:1787848387.954717:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631390976 00000100:00100000:1.0:1787848387.954721:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631390976 00000100:00080000:0.0:1787848387.954780:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787848387.954784:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787848387.954795:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631390976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848387.954850:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631390976:12345-0@lo:400:kworker.0 Request processed in 57us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848387.954856:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787848387.955053:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631390592 00000100:00100000:3.0:1787848387.955072:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631390592 00000100:00100000:3.0:1787848387.955113:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787848387.955121:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3313:x1874694631390592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848387.955426:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3313:x1874694631390592:12345-0@lo:400:kworker.0 Request processed in 37us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848387.955433:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00010000:00080000:0.0:1787848387.958072:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7964ad00 x1874694631390976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848387.958094:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7964ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631390976:0@lo:400:kworker.0 00000100:00100000:0.0:1787848387.958108:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631390592:0@lo:400:kworker.0 00000100:00100000:1.0:1787848388.463869:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787848388.463892:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f432580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631391360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848388.463959:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848388.464038:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631391360 00000100:00100000:1.0:1787848388.464046:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631391360 00000100:00100000:1.0:1787848388.464106:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787848388.464114:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631391360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787848388.464145:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848388.464189:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631391360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848388.464197:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787848388.464239:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f432580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631391360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848388.464635:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631391488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848388.464685:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848388.464804:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631391488 00000100:00100000:2.0:1787848388.464809:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631391488 00000100:00100000:2.0:1787848388.464843:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787848388.464850:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f432580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631391488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848388.464871:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848388.464911:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f432580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631391488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848388.464917:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1787848388.464979:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb4a580 x1874694631391488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848388.464995:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631391488:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787848388.655892:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848389.680015:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848390.343168:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848390.343243:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848390.343349:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611428480 00000100:00100000:0.0:1787848390.343366:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611428480 00000100:00100000:0.0:1787848390.343451:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 136 00000100:00100000:0.0:1787848390.343464:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611428480:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848390.343539:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611428480:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 80us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848390.343548:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 136 00000100:00080000:1.0:1787848390.343661:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848390.344535:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611428352 00000100:00100000:3.0:1787848390.344553:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611428352 00000100:00100000:3.0:1787848390.344603:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 289 00000100:00100000:3.0:1787848390.344612:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611428352:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848390.344697:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611428352:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 85us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848390.344704:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 289 00000100:00100000:1.0:1787848390.346774:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848390.346819:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848390.347048:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611428736 00000100:00100000:2.0:1787848390.347058:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611428736 00000100:00080000:1.0:1787848390.347163:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848390.347286:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 137 00000100:00100000:2.0:1787848390.347298:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2353:x1874694611428736:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848390.347381:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2353:x1874694611428736:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 87us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848390.347389:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 137 00000100:00100000:0.0:1787848390.347944:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611428608 00000100:00100000:0.0:1787848390.347951:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611428608 00000100:00100000:0.0:1787848390.348876:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00100000:0.0:1787848390.348889:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611428608:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848390.348959:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611428608:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 75us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848390.348966:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00080000:1.0:1787848390.350517:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787848390.703882:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848391.730585:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848392.753802:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848393.072315:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631391872:0@lo:400:kworker.0 00000100:00100000:0.0:1787848393.072404:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848393.072479:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787848393.072486:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f4330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631391744:0@lo:400:kworker.0 00000100:00100000:0.0:1787848393.072536:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848393.072558:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631392256:0@lo:400:kworker.0 00000100:00100000:0.0:1787848393.072589:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848393.072631:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631391872 00000100:00100000:0.0:1787848393.072691:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631391872 00000100:00100000:0.0:1787848393.072757:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631391744 00000100:00100000:0.0:1787848393.072760:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631391744 00000100:00100000:0.0:1787848393.072786:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787848393.072795:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631391872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848393.072862:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631391872:12345-0@lo:400:kworker.0 Request processed in 67us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848393.072869:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787848393.072888:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787848393.072895:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631391744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848393.072924:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631391744:12345-0@lo:400:kworker.0 Request processed in 30us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848393.072929:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787848393.072953:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631392256 00000100:00100000:0.0:1787848393.072957:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631392256 00000100:00100000:0.0:1787848393.072983:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787848393.072989:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631392256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848393.073021:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631392256:12345-0@lo:400:kworker.0 Request processed in 32us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848393.073027:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787848393.073072:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f4330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631391744:0@lo:400:kworker.0 00000100:00100000:0.0:1787848393.073082:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631392256:0@lo:400:kworker.0 00000100:00100000:0.0:1787848393.073091:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631391872:0@lo:400:kworker.0 00000100:00100000:1.0:1787848393.073201:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f431e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631391616:0@lo:400:kworker.0 00000100:00100000:1.0:1787848393.073245:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848393.073280:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f431a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631392128:0@lo:400:kworker.0 00000100:00100000:1.0:1787848393.073304:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848393.073322:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787848393.073328:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f4312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631392000:0@lo:400:kworker.0 00000100:00100000:1.0:1787848393.073349:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787848393.073374:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848393.073379:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848393.073389:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631392000 00000100:00100000:1.0:1787848393.073393:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631392000 00000100:00100000:1.0:1787848393.073425:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787848393.073433:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631392000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848393.073468:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631392000:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848393.073474:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787848393.073491:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787848393.073508:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff5f4312c0 x1874694631392000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848393.073518:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f4312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631392000:0@lo:400:kworker.0 00000100:00100000:2.0:1787848393.073687:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631392128 00000100:00100000:2.0:1787848393.073691:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631392128 00000100:00100000:2.0:1787848393.073737:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787848393.073746:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631392128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848393.073787:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631392128:12345-0@lo:400:kworker.0 Request processed in 43us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848393.073794:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787848393.073820:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f431a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631392128:0@lo:400:kworker.0 00000100:00080000:1.0:1787848393.073886:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848393.076782:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631391616 00000100:00100000:0.0:1787848393.076800:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631391616 00000100:00100000:0.0:1787848393.076885:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787848393.076896:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3313:x1874694631391616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848393.077007:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3313:x1874694631391616:12345-0@lo:400:kworker.0 Request processed in 113us (3760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848393.077031:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787848393.077966:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f431e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631391616:0@lo:400:kworker.0 00000100:00100000:3.0:1787848393.584985:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787848393.585017:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631392384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848393.585067:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787848393.585078:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631392512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848393.585098:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848393.585125:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631392384 00000100:00100000:2.0:1787848393.585134:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631392384 00000100:00100000:2.0:1787848393.585208:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787848393.585218:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631392384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848393.585266:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848393.594669:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631392384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9419us (9537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848393.594687:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787848393.602674:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631392384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848393.608128:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848393.608296:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631392512 00000100:00100000:1.0:1787848393.608307:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631392512 00000100:00100000:1.0:1787848393.608363:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787848393.608372:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631392512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848393.608414:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848393.608548:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631392512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848393.608569:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1787848393.608721:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fb4a580 x1874694631392512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848393.608740:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631392512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787848393.776202:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848394.800137:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787848395.312402:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787848395.486765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848395.486832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848395.487083:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611428864 00000100:00100000:2.0:1787848395.487093:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611428864 00000100:00100000:2.0:1787848395.487166:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 291 00000100:00100000:2.0:1787848395.487178:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611428864:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848395.487256:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611428864:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 80us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848395.487264:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 291 00000100:00100000:3.0:1787848395.488081:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611428992 00000100:00100000:3.0:1787848395.488089:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611428992 00000100:00100000:3.0:1787848395.488162:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 141 00000100:00100000:3.0:1787848395.488171:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611428992:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848395.488224:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611428992:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 56us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848395.488231:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 141 00000100:00080000:0.0:1787848395.488738:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848395.509044:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848395.509100:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848395.509244:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611429248 00000100:00100000:3.0:1787848395.509256:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611429248 00000100:00100000:3.0:1787848395.509345:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 142 00000100:00100000:3.0:1787848395.509357:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611429248:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848395.509465:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611429248:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 111us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848395.509474:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 142 00000100:00100000:1.0:1787848395.510056:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611429120 00000100:00100000:1.0:1787848395.510062:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611429120 00000100:00100000:1.0:1787848395.510106:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:1.0:1787848395.510115:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2350:x1874694611429120:12345-192.168.201.26@tcp:9:kworker.0 00000020:00000080:1.0:1787848395.510137:0:11455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb6a8 00000100:00080000:1.0:1787848395.510146:0:11455:0:(import.c:65:import_set_state_nolock()) ffff93ff5f357000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787848395.510186:0:11455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787848395.510446:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+2:2350:x1874694611429120:12345-192.168.201.26@tcp:9:kworker.0 Request processed in 333us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848395.510454:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00010000:00010000:3.0:1787848395.510670:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787848395.511633:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787848395.511666:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787848395.824083:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848396.848053:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848397.881902:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848398.192938:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7964b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631392896:0@lo:400:kworker.0 00000100:00100000:3.0:1787848398.193039:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848398.193111:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787848398.193118:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631392768:0@lo:400:kworker.0 00000100:00100000:3.0:1787848398.193144:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848398.193162:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631393280:0@lo:400:kworker.0 00000100:00100000:3.0:1787848398.193201:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848398.193240:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631392896 00000100:00100000:3.0:1787848398.193247:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631392896 00000100:00100000:3.0:1787848398.193300:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631392768 00000100:00100000:3.0:1787848398.193303:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631392768 00000100:00100000:3.0:1787848398.193338:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787848398.193347:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631392896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848398.193402:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631392896:12345-0@lo:400:kworker.0 Request processed in 56us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848398.193408:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787848398.193424:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787848398.193430:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52190b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631392768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848398.193456:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52190b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631392768:12345-0@lo:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848398.193825:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787848398.193855:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631393280 00000100:00100000:3.0:1787848398.193858:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631393280 00000100:00100000:3.0:1787848398.193903:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787848398.193911:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff521903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631393280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848398.193946:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff521903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631393280:12345-0@lo:400:kworker.0 Request processed in 36us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848398.193953:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1787848398.193969:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848398.193974:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848398.194011:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631392768:0@lo:400:kworker.0 00000100:00100000:3.0:1787848398.194022:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631393280:0@lo:400:kworker.0 00000100:00100000:3.0:1787848398.194032:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7964b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631392896:0@lo:400:kworker.0 00000100:00100000:2.0:1787848398.194203:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff796483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631393024:0@lo:400:kworker.0 00000100:00100000:2.0:1787848398.194240:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848398.194275:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787848398.194282:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7964ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631392640:0@lo:400:kworker.0 00000100:00100000:2.0:1787848398.194310:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848398.194346:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631393152:0@lo:400:kworker.0 00000100:00100000:2.0:1787848398.194380:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848398.194408:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631393152 00000100:00100000:2.0:1787848398.194412:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631393152 00000100:00100000:2.0:1787848398.194443:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787848398.194451:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631393152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848398.194510:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631393152:12345-0@lo:400:kworker.0 Request processed in 51us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848398.194517:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787848398.194545:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631393152:0@lo:400:kworker.0 00000100:00100000:3.0:1787848398.195025:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631393024 00000100:00100000:3.0:1787848398.195031:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631393024 00000100:00100000:3.0:1787848398.195073:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787848398.195082:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631393024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848398.195133:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631393024:12345-0@lo:400:kworker.0 Request processed in 52us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848398.195139:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787848398.195158:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631392640 00000100:00100000:3.0:1787848398.195162:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631392640 00000100:00100000:3.0:1787848398.195199:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787848398.195206:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631392640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848398.195237:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631392640:12345-0@lo:400:kworker.0 Request processed in 32us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848398.195253:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:3.0:1787848398.195283:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848398.195287:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848398.195437:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7964ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631392640:0@lo:400:kworker.0 00010000:00080000:0.0:1787848398.195451:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff796483c0 x1874694631393024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848398.195461:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff796483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631393024:0@lo:400:kworker.0 00000100:00100000:0.0:1787848398.704033:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848398.704061:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631393536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848398.704079:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631393408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848398.715041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848398.715402:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631393408 00000100:00100000:2.0:1787848398.715412:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631393408 00000100:00100000:2.0:1787848398.715471:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787848398.715480:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52193c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631393408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848398.715520:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848398.715602:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52193c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631393408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848398.715608:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787848398.716814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848398.716966:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631393536 00000100:00100000:2.0:1787848398.716974:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631393536 00000100:00100000:2.0:1787848398.717032:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787848398.717038:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631393408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848398.717046:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631393536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848398.717078:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848398.717437:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631393536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 393us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848398.717445:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1787848398.717578:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7956e580 x1874694631393536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848398.717596:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631393536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787848398.897096:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787848399.787880:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00000020:00000080:2.0:1787848399.787904:0:7658:0:(genops.c:885:class_export_put()) final put ffff93ff5f354800/8bb0bb0f-4511-40a8-bdfa-25f441891529 00000020:00000080:0.0:1787848399.787984:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f354800/8bb0bb0f-4511-40a8-bdfa-25f441891529 for lustre-OST0001 00000020:00000080:0.0:1787848399.788038:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff5f357000 for lustre-OST0001 00010000:00010000:3.0:1787848399.920131:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848400.581917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848400.581982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848400.582027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848400.582193:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611429504 00000100:00100000:2.0:1787848400.582205:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611429504 00000100:00100000:2.0:1787848400.582272:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611429632 00000100:00100000:2.0:1787848400.582275:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611429632 00000100:00100000:2.0:1787848400.582300:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 146 00000100:00100000:2.0:1787848400.582309:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611429504:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848400.582388:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611429504:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 80us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848400.582395:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 146 00000100:00100000:2.0:1787848400.582412:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 147 00000100:00100000:2.0:1787848400.582419:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611429632:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848400.582439:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611429632:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 21us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848400.582444:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 147 00000100:00080000:0.0:1787848400.582617:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848400.583236:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611429376 00000100:00100000:1.0:1787848400.583243:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611429376 00000100:00100000:1.0:1787848400.583286:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 293 00000100:00100000:1.0:1787848400.583293:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611429376:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848400.583342:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611429376:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 49us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848400.583348:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 293 00010000:00010000:3.0:1787848400.944023:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848401.968270:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848403.008056:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848403.312535:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848403.312633:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848403.312688:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80748780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631394048:0@lo:400:kworker.0 00000100:00100000:3.0:1787848403.312791:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848403.312862:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff8074b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631393920:0@lo:400:kworker.0 00000100:00100000:3.0:1787848403.312891:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848403.312913:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787848403.312918:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff8074a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631393792:0@lo:400:kworker.0 00000100:00100000:3.0:1787848403.312940:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848403.312973:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631394048 00000100:00100000:3.0:1787848403.312980:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631394048 00000100:00100000:3.0:1787848403.313035:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787848403.313044:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631394048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848403.313098:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631394048:12345-0@lo:400:kworker.0 Request processed in 56us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848403.313106:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787848403.313128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631393920 00000100:00100000:3.0:1787848403.313145:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631393920 00000100:00100000:3.0:1787848403.313171:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631393792 00000100:00100000:3.0:1787848403.313174:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631393792 00000100:00100000:3.0:1787848403.313202:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787848403.313209:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff521921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631393920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848403.313241:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff521921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631393920:12345-0@lo:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848403.313247:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787848403.313256:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787848403.313262:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52190f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631393792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848403.313284:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52190f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631393792:12345-0@lo:400:kworker.0 Request processed in 23us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848403.313290:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1787848403.313308:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787848403.313313:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787848403.313349:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff8074a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631393792:0@lo:400:kworker.0 00000100:00100000:3.0:1787848403.313358:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff8074b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631393920:0@lo:400:kworker.0 00010000:00080000:3.0:1787848403.313387:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff80748780 x1874694631394048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848403.313397:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80748780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631394048:0@lo:400:kworker.0 00000100:00100000:1.0:1787848403.319966:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7956e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631393664:0@lo:400:kworker.0 00000100:00100000:1.0:1787848403.320055:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848403.320189:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631393664 00000100:00100000:3.0:1787848403.320198:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631393664 00000100:00100000:3.0:1787848403.320250:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787848403.320259:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631393664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848403.320314:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631393664:12345-0@lo:400:kworker.0 Request processed in 57us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848403.320329:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787848403.320374:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7956e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631393664:0@lo:400:kworker.0 00000100:00100000:2.0:1787848403.336452:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631394176:0@lo:400:kworker.0 00000100:00100000:2.0:1787848403.336543:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848403.336600:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631394304:0@lo:400:kworker.0 00000100:00100000:2.0:1787848403.336631:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848403.336685:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631394176 00000100:00100000:2.0:1787848403.336693:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631394176 00000100:00100000:2.0:1787848403.336769:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787848403.336958:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631394176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848403.337017:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631394176:12345-0@lo:400:kworker.0 Request processed in 240us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848403.337041:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787848403.337065:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631394304 00000100:00100000:2.0:1787848403.337069:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631394304 00000100:00100000:2.0:1787848403.337095:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787848403.337102:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631394304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848403.337139:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631394304:12345-0@lo:400:kworker.0 Request processed in 38us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848403.337145:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1787848403.337162:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787848403.337167:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848403.337209:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631394176:0@lo:400:kworker.0 00000100:00100000:2.0:1787848403.337241:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631394304:0@lo:400:kworker.0 00000100:00100000:0.0:1787848403.824067:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631394432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848403.824153:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848403.824429:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631394432 00000100:00100000:2.0:1787848403.824440:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631394432 00000100:00100000:2.0:1787848403.824515:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787848403.824525:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631394432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848403.824567:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848403.824622:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631394432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848403.824629:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1787848403.824931:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff80749e00 x1874694631394432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848403.824955:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631394432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848403.827966:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787848403.827990:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631394560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848403.828063:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848403.828383:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631394560 00000100:00100000:0.0:1787848403.828391:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631394560 00000100:00100000:0.0:1787848403.828525:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787848403.828537:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff53137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631394560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787848403.828575:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848403.828675:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff53137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631394560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848403.828683:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787848403.828893:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631394560:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787848404.016866:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848405.039788:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787848405.552383:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787848405.702228:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848405.702275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848405.702318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848405.702414:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611429888 00000100:00100000:3.0:1787848405.702426:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611429888 00000100:00100000:2.0:1787848405.702442:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611430016 00000100:00100000:2.0:1787848405.702458:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611430016 00000100:00100000:1.0:1787848405.702534:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611429760 00000100:00100000:1.0:1787848405.702539:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611429760 00000100:00100000:1.0:1787848405.702580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 295 00000100:00100000:1.0:1787848405.702590:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611429760:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848405.702679:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611429760:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 90us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848405.702687:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 295 00000100:00100000:2.0:1787848405.702780:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 151 00000100:00100000:2.0:1787848405.702789:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611430016:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848405.702836:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611430016:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 49us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848405.702843:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 151 00000100:00080000:0.0:1787848405.702863:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848405.710252:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 152 00000100:00100000:3.0:1787848405.710280:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611429888:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848405.710390:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611429888:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 125us (8174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848405.710398:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 152 00010000:00010000:1.0:1787848406.063879:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848407.091510:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787848407.236386:0:11867:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:33:26 (1787848406) 00010000:00010000:1.0:1787848408.111849:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848408.431995:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631394944:0@lo:400:kworker.0 00000100:00100000:0.0:1787848408.432091:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848408.432160:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787848408.432166:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631394816:0@lo:400:kworker.0 00000100:00100000:0.0:1787848408.432191:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848408.432228:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631395328:0@lo:400:kworker.0 00000100:00100000:0.0:1787848408.432257:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848408.432294:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631394944 00000100:00100000:0.0:1787848408.432301:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631394944 00000100:00100000:0.0:1787848408.432356:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631394816 00000100:00100000:0.0:1787848408.432360:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631394816 00000100:00100000:0.0:1787848408.432385:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787848408.432393:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631394944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848408.432456:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631394944:12345-0@lo:400:kworker.0 Request processed in 63us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848408.432463:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787848408.432481:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787848408.432487:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631394816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848408.432515:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631394816:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848408.432521:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1787848408.432686:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848408.432701:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631395328 00000100:00100000:3.0:1787848408.432705:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631395328 00000100:00100000:3.0:1787848408.432741:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787848408.432748:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631395328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848408.432783:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631395328:12345-0@lo:400:kworker.0 Request processed in 36us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848408.432790:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787848408.432809:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787848408.432853:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631394816:0@lo:400:kworker.0 00000100:00100000:3.0:1787848408.432865:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631395328:0@lo:400:kworker.0 00000100:00100000:3.0:1787848408.432873:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631394944:0@lo:400:kworker.0 00000100:00100000:2.0:1787848408.432968:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631395072:0@lo:400:kworker.0 00000100:00100000:2.0:1787848408.433002:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848408.433033:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787848408.433039:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631394688:0@lo:400:kworker.0 00000100:00100000:2.0:1787848408.433063:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848408.433087:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631395200:0@lo:400:kworker.0 00000100:00100000:2.0:1787848408.433107:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848408.433132:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631395200 00000100:00100000:2.0:1787848408.433136:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631395200 00000100:00100000:2.0:1787848408.433172:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787848408.433180:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631395200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848408.433214:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631395200:12345-0@lo:400:kworker.0 Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848408.433220:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787848408.433240:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631394688 00000100:00100000:2.0:1787848408.433243:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631394688 00000100:00100000:2.0:1787848408.433265:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787848408.433272:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631394688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848408.433302:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631394688:12345-0@lo:400:kworker.0 Request processed in 31us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848408.433309:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:2.0:1787848408.433336:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848408.433363:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631394688:0@lo:400:kworker.0 00000100:00100000:2.0:1787848408.433372:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631395200:0@lo:400:kworker.0 00000100:00100000:3.0:1787848408.433686:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631395072 00000100:00100000:3.0:1787848408.433690:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631395072 00000100:00100000:3.0:1787848408.433736:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787848408.433743:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631395072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848408.433778:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631395072:12345-0@lo:400:kworker.0 Request processed in 36us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848408.433784:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787848408.433994:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787848408.434031:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff444a4780 x1874694631395072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787848424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848408.434042:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631395072:0@lo:400:kworker.0 00000100:00100000:1.0:1787848408.943964:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787848408.943988:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631395456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848408.944055:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848408.944166:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631395456 00000100:00100000:2.0:1787848408.944174:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631395456 00000100:00100000:2.0:1787848408.944231:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787848408.944239:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631395456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848408.944273:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848408.944314:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631395456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848408.944320:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1787848408.944530:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807483c0 x1874694631395456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848408.944548:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631395456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787848408.944752:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff559b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631395584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848408.944782:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848408.944856:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631395584 00000100:00100000:3.0:1787848408.944860:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631395584 00000100:00100000:3.0:1787848408.944890:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787848408.944897:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631395584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787848408.944916:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848408.944954:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631395584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848408.944960:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787848408.945072:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff559b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631395584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787848409.135918:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848409.410635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848409.410762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611430144 00000100:00100000:3.0:1787848409.410773:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611430144 00000100:00100000:3.0:1787848409.410909:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:3.0:1787848409.410921:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:10245:x1874694611430144:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787848409.410939:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848409.410999:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1f6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848409.411069:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb77a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848409.411093:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848409.411113:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848409.411323:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787848409.411328:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848409.411432:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848409.411453:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1f6 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848409.411466:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb77a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1f6 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848409.411473:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1900) 00010000:00010000:3.0:1787848409.411476:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787848409.411479:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237000, rc 0) 00000100:00100000:3.0:1787848409.411903:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:10245:x1874694611430144:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 983us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848409.411912:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00080000:2.0:1787848409.418231:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848409.448570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848409.448697:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611430272 00000100:00100000:2.0:1787848409.448708:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611430272 00000100:00100000:2.0:1787848409.448809:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:2.0:1787848409.448820:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:10247:x1874694611430272:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848409.448856:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848409.448882:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb1fd expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.448946:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb788 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.448976:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.448989:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449005:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb78f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449012:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449018:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449438:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb796 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449448:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb796 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449455:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb796 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848409.449536:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787848409.449541:0:7097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787848409.449617:0:7097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb796 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449630:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449700:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb788 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449707:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb788 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449713:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848409.449718:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb788 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449725:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb788 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449737:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1900) 00010000:00010000:2.0:1787848409.449740:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848409.449745:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb788 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449752:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449764:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449770:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb78f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449776:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb78f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449781:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665e00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848409.449790:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb78f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449796:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb78f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449804:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93ff53a89e00) 00010000:00010000:2.0:1787848409.449806:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848409.449809:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb78f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449815:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cb78f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449845:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cb781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1fd expref: 8 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449857:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb796 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1fd expref: 7 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848409.449865:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ff53a89b00) 00010000:00010000:2.0:1787848409.449867:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787848409.449869:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665000, rc 0) 00000100:00100000:2.0:1787848409.449922:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:10247:x1874694611430272:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 1104us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848409.449929:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:1.0:1787848409.463287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848409.463393:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611430528 00000100:00100000:0.0:1787848409.463403:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611430528 00000100:00100000:0.0:1787848409.463464:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:0.0:1787848409.463476:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:10247:x1874694611430528:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787848409.463498:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848409.463519:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb79d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb204 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.463599:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb7a4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.463630:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb7a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.463673:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb7a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.463693:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb7ab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.463699:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb7ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.463706:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb7ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465440:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031a00/0x9aeb41e0543cb7b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465461:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031a00/0x9aeb41e0543cb7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465473:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031a00/0x9aeb41e0543cb7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848409.465484:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787848409.465728:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb7a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465735:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb7a4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465742:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb7a4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465756:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848409.465761:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb7a4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465769:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb7a4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465782:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ff53a89b00) 00010000:00010000:0.0:1787848409.465786:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848409.465790:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb7a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465794:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb7a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465805:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb7ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465811:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb7ab lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465816:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb7ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465821:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848409.465823:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb7ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465829:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb7ab lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465847:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93ff48373300) 00010000:00010000:0.0:1787848409.465849:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848409.465852:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb7ab lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.465858:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb7ab lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.467707:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb79d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb204 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.467733:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031a00/0x9aeb41e0543cb7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb204 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848409.467741:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:0.0:1787848409.467744:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848409.467747:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40031a00, rc 0) 00000100:00100000:0.0:1787848409.467839:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:10247:x1874694611430528:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 4365us (4561us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787848409.467850:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:0.0:1787848409.472235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848409.475034:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611430656 00000100:00100000:2.0:1787848409.475047:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611430656 00000100:00100000:2.0:1787848409.475191:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:2.0:1787848409.475205:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:10247:x1874694611430656:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787848409.475563:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:10247:x1874694611430656:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 Request processed in 362us (3338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848409.475572:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 35 00000040:00080000:2.0:1787848409.650889:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1787848410.029853:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:1.0:1787848410.161397:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848410.838307:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848410.838341:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848410.838389:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848410.838421:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611430784 00000100:00100000:3.0:1787848410.838431:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611430784 00000100:00100000:3.0:1787848410.838479:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 297 00000100:00100000:3.0:1787848410.838489:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611430784:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848410.838578:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611430784:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848410.838595:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 297 00000100:00100000:3.0:1787848410.838704:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611431040 00000100:00100000:3.0:1787848410.838709:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611431040 00000100:00100000:3.0:1787848410.838747:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611430912 00000100:00100000:3.0:1787848410.838751:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611430912 00000100:00100000:3.0:1787848410.838773:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 156 00000100:00100000:3.0:1787848410.838781:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52191680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611431040:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848410.838814:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52191680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611431040:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 34us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848410.838820:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 156 00000100:00100000:3.0:1787848410.838833:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 157 00000100:00100000:3.0:1787848410.838840:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52192d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611430912:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848410.838863:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52192d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611430912:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848410.838869:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 157 00000100:00080000:3.0:1787848410.838891:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787848411.190421:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848411.964867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848411.966825:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611431168 00000100:00100000:2.0:1787848411.966840:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611431168 00000100:00100000:2.0:1787848411.966930:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:2.0:1787848411.966942:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:10289:x1874694611431168:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848411.966964:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848411.966986:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb7c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb20b expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.967060:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb7c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.967075:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb7c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.967086:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb7c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.967101:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb7ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.967109:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.967116:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968148:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb7c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968161:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb7c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968168:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb7c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968174:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848411.968178:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb7c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968186:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb7c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968201:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1900) 00010000:00010000:2.0:1787848411.968205:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848411.968209:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb7c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968216:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb7c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968231:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968237:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb7ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968244:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb7ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968258:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848411.968261:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb7ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787848411.968364:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787848411.968393:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb7ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968405:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93ff53a89e00) 00010000:00010000:2.0:1787848411.968408:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848411.968411:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb7ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968418:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb7ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968455:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb7c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb20b expref: 9 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968467:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1900) 00010000:00010000:2.0:1787848411.968469:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848411.968473:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb7c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb20b expref: 9 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848411.968482:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664c00, rc 0) 00000100:00100000:2.0:1787848411.968587:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:10289:x1874694611431168:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1648us (3731us total) trans 0 rc 301/301 00000100:00100000:2.0:1787848411.968596:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:3.0:1787848411.986447:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848411.986936:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611431424 00000100:00100000:3.0:1787848411.986947:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611431424 00000100:00100000:3.0:1787848411.986995:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:3.0:1787848411.987004:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52193840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:10289:x1874694611431424:12345-192.168.201.26@tcp:36:lfs.0 00010000:00010000:3.0:1787848411.987108:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848411.987138:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb77a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1f6 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.987342:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1900) 00010000:00010000:3.0:1787848411.987355:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848411.987943:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.987959:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.987969:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.987980:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7dc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.987987:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.987994:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848411.991390:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787848411.991414:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.991425:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7d5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.991433:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.991439:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848411.991453:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.991461:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7d5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.991494:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:3.0:1787848411.991497:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848411.991502:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.991508:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7d5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787848411.991530:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004130e08a reply state 000000009afe1b94 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848411.991539:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787848411.991695:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52193840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:10289:x1874694611431424:12345-192.168.201.26@tcp:36:lfs.0 Request processed in 4687us (5250us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787848411.991705:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 37 00010000:00010000:3.0:1787848411.995228:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.995245:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7dc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.995253:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7dc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.995259:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848411.995265:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7dc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.995288:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7dc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.995306:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93ff541a1a00) 00010000:00010000:3.0:1787848411.995309:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848411.995313:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7dc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848411.995319:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7dc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848412.120987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848412.121235:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611431552 00000100:00100000:0.0:1787848412.121246:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611431552 00000100:00100000:0.0:1787848412.121323:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:0.0:1787848412.121349:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52190780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:10297:x1874694611431552:12345-192.168.201.26@tcp:101:lctl.0 00010000:00010000:0.0:1787848412.121389:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848412.121413:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb7e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb212 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.121495:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cb7ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.121510:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cb7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.121522:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cb7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848412.121590:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787848412.121594:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848412.121937:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cb7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.121965:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb7e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb212 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.121983:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cb7ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb212 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.121991:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:0.0:1787848412.121994:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848412.121997:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030a00, rc 0) 00000100:00100000:0.0:1787848412.122066:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52190780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:10297:x1874694611431552:12345-192.168.201.26@tcp:101:lctl.0 Request processed in 735us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848412.122073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:2.0:1787848412.195917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848412.196036:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611431680 00000100:00100000:3.0:1787848412.196452:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611431680 00000100:00100000:3.0:1787848412.196578:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:3.0:1787848412.196590:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:10303:x1874694611431680:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787848412.196611:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848412.196633:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb219 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.196841:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.196857:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.196877:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.196893:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb7ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.196909:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.196916:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197030:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237e00/0x9aeb41e0543cb806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197039:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237e00/0x9aeb41e0543cb806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197241:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237e00/0x9aeb41e0543cb806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848412.197787:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787848412.197793:0:7097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848412.197854:0:7097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237e00/0x9aeb41e0543cb806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197870:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197876:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197882:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197888:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848412.197892:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197910:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197925:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:3.0:1787848412.197928:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848412.197933:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197940:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb7f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197964:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197971:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb7ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197977:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb7ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197983:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848412.197986:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb7ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197992:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb7ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.197999:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93ff541a1a00) 00010000:00010000:3.0:1787848412.198002:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848412.198005:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb7ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.198021:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb7ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.198962:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb7f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb219 expref: 11 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.198994:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237e00/0x9aeb41e0543cb806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb219 expref: 10 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.199004:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:3.0:1787848412.199007:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787848412.199010:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237e00, rc 0) 00000100:00100000:3.0:1787848412.199108:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:10303:x1874694611431680:12345-192.168.201.26@tcp:101:bash.0 Request processed in 2520us (3199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848412.199117:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:1.0:1787848412.207390:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:1.0:1787848412.208955:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848412.209367:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611431936 00000100:00100000:3.0:1787848412.209381:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611431936 00000100:00100000:3.0:1787848412.209460:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:3.0:1787848412.209480:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:10303:x1874694611431936:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787848412.209501:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848412.209523:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cb80d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb220 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.210443:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb814 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.210521:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb814 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.210543:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb814 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.210885:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb81b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.210895:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb81b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.210903:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb81b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787848412.221791:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787848412.222089:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.222106:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.222118:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.224489:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb814 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.224507:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb814 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.224515:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb814 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.224521:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848412.224543:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb814 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.224552:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb814 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.224579:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:3.0:1787848412.224582:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848412.224586:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb814 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.224593:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb814 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787848412.224613:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008e7b4ef reply state 00000000f35b9751 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb81b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848412.224632:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787848412.226927:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cb80d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb220 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.226957:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb220 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.226967:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:3.0:1787848412.226970:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848412.226974:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236c00, rc 0) 00000100:00100000:3.0:1787848412.227063:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10303:x1874694611431936:12345-192.168.201.26@tcp:101:bash.0 Request processed in 17584us (19681us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787848412.227072:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 40 00010000:00010000:3.0:1787848412.232450:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb81b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.232470:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb81b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.232479:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb81b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.232485:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848412.232491:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb81b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.232499:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb81b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.232518:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff541a1900) 00010000:00010000:3.0:1787848412.232521:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848412.232526:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb81b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.232533:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb81b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848412.233125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848412.241796:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611432064 00000100:00100000:3.0:1787848412.241811:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611432064 00000100:00100000:3.0:1787848412.252253:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:3.0:1787848412.252277:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1874694611432064:12345-192.168.201.26@tcp:8:bash.0 00010000:00080000:3.0:1787848412.252314:0:6689:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:3.0:1787848412.252360:0:6689:0:(genops.c:1385:class_connect()) connect: client 8bb0bb0f-4511-40a8-bdfa-25f441891529, cookie 0x9aeb41e0543cb830 00002000:00100000:3.0:1787848412.252375:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8bb0bb0f-4511-40a8-bdfa-25f441891529/ffff93ff7fa79000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787848412.252421:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787848412.252893:0:6689:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787848412.252930:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93ff60305800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787848412.253247:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2350:x1874694611432064:12345-192.168.201.26@tcp:8:bash.0 Request processed in 969us (20124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848412.253257:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:1.0:1787848412.274752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848412.274898:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611432192 00000100:00100000:3.0:1787848412.274908:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611432192 00000100:00100000:3.0:1787848412.274982:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:3.0:1787848412.274992:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:0:x1874694611432192:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787848412.275012:0:11455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848412.275036:0:11455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c17be32d/0x9aeb41e0543cb837 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb227 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787848412.275069:0:11455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787848412.275091:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1787848412.275096:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848412.275105:0:11455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c17be32d/0x9aeb41e0543cb837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb227 expref: 7 pid: 11455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.275138:0:11455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c17be32d/0x9aeb41e0543cb837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb227 expref: 7 pid: 11455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.275152:0:11455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236400, rc 0) 00000100:00100000:3.0:1787848412.275218:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:0:x1874694611432192:12345-192.168.201.26@tcp:101:bash.0 Request processed in 228us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848412.275243:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00080000:0.0:1787848412.275577:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848412.285118:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848412.285894:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611432320 00000100:00100000:3.0:1787848412.285906:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611432320 00000100:00100000:3.0:1787848412.285973:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:3.0:1787848412.285984:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80748780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:10303:x1874694611432320:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787848412.286003:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848412.286025:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb22e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.286061:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c17be32d/0x9aeb41e0543cb837 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb227 expref: 8 pid: 11455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.286071:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848412.286075:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848412.286080:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.286118:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c17be32d/0x9aeb41e0543cb837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb227 expref: 8 pid: 11455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.286143:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c17be32d/0x9aeb41e0543cb837 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb227 expref: 8 pid: 11455 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848412.286159:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff52192580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1874694631395712:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848412.286273:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fcacd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787848412.295142:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff52192580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1874694631395712:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848412.295187:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.295210:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236e00, rc 0) 00000100:00100000:3.0:1787848412.295287:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80748780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:10303:x1874694611432320:12345-192.168.201.26@tcp:101:bash.0 Request processed in 9304us (10179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848412.295296:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:2.0:1787848412.297562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848412.297766:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611432448 00000100:00100000:3.0:1787848412.297774:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611432448 00010000:00010000:3.0:1787848412.297811:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c17be32d/0x9aeb41e0543cb837 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb227 expref: 8 pid: 11455 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848412.297852:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:3.0:1787848412.297861:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611432448:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848412.297875:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848412.297899:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c17be32d/0x9aeb41e0543cb837 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb227 expref: 8 pid: 11455 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.297914:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c17be32d/0x9aeb41e0543cb837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb227 expref: 8 pid: 11455 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.297936:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c17be32d/0x9aeb41e0543cb837 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb227 expref: 8 pid: 11455 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.297951:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848412.297968:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848412.297976:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.297987:0:8522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.298026:0:8522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848412.298040:0:8522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff52192580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8522:1874694631395840:192.168.201.26@tcp:105: 00000100:00100000:3.0:1787848412.299564:0:8522:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fcacd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787848412.304125:0:8522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff52192580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8522:1874694631395840:192.168.201.26@tcp:105: 00010000:00010000:3.0:1787848412.304159:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848412.304228:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611432448:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 6367us (6673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848412.304241:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:0.0:1787848412.318057:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848412.318171:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611432704 00000100:00100000:2.0:1787848412.318180:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611432704 00000100:00100000:2.0:1787848412.318238:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:2.0:1787848412.318248:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:10303:x1874694611432704:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:2.0:1787848412.318700:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10303:x1874694611432704:12345-192.168.201.26@tcp:35:bash.0 Request processed in 450us (651us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787848412.318708:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:2.0:1787848412.435477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848412.435632:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611432960 00000100:00100000:0.0:1787848412.435677:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611432960 00000100:00100000:0.0:1787848412.435743:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:0.0:1787848412.435754:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10313:x1874694611432960:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848412.435781:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848412.435802:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb845 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb235 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848412.435925:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787848412.436066:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb845 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb235 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.436083:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:0.0:1787848412.436086:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787848412.436091:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb845 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb235 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.436107:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030e00, rc 0) 00000100:00100000:0.0:1787848412.436183:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10313:x1874694611432960:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 431us (717us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787848412.436192:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:0.0:1787848412.439258:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848412.439589:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611433216 00000100:00100000:2.0:1787848412.439601:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611433216 00000100:00100000:2.0:1787848412.439817:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:2.0:1787848412.439829:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10313:x1874694611433216:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787848412.440110:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:10313:x1874694611433216:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 282us (863us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787848412.440119:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:1.0:1787848412.576373:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848412.576535:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611433344 00000100:00100000:3.0:1787848412.576545:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611433344 00000100:00100000:3.0:1787848412.576613:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:3.0:1787848412.576625:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:10319:x1874694611433344:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848412.576679:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848412.576702:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb853 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb23c expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.576776:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb85a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.576807:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb85a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.576819:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb85a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848412.576880:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787848412.576885:0:7097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848412.576909:0:7097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb85a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.576935:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb23c expref: 17 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.576955:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb85a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb23c expref: 16 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.576964:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:3.0:1787848412.576967:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787848412.576970:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237c00, rc 0) 00000100:00100000:3.0:1787848412.577046:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:10319:x1874694611433344:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 415us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848412.577053:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:1.0:1787848412.586927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848412.587167:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611433600 00000100:00100000:3.0:1787848412.587179:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611433600 00000100:00100000:3.0:1787848412.587240:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:3.0:1787848412.587251:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:10319:x1874694611433600:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848412.587273:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848412.587308:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb861 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb243 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.587421:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.587436:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.587447:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848412.587457:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787848412.587588:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb861 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb243 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.587608:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb243 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.587626:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:3.0:1787848412.587629:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848412.587632:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237000, rc 0) 00000100:00100000:3.0:1787848412.587745:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10319:x1874694611433600:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 495us (827us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787848412.587752:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:0.0:1787848412.601862:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848412.601911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848412.601998:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611433856 00000100:00100000:3.0:1787848412.602009:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611433856 00000100:00100000:2.0:1787848412.602031:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611433984 00000100:00100000:2.0:1787848412.602044:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611433984 00000100:00100000:3.0:1787848412.602069:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:3.0:1787848412.602079:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10319:x1874694611433856:12345-192.168.201.26@tcp:101:lfs.0 00000100:00100000:2.0:1787848412.602088:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:2.0:1787848412.602095:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:2354:x1874694611433984:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848412.602108:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848412.602115:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848412.602131:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cb868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb243 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848412.602151:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:2.0:1787848412.602163:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848412.602217:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:2354:x1874694611433984:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 122us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848412.602226:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00010000:00010000:3.0:1787848412.602342:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb24a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.602443:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb87d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.602458:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb87d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.602469:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb87d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848412.602480:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787848412.602745:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cb876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb24a expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.602768:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb87d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb24a expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.602776:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:1.0:1787848412.602779:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787848412.602782:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237800, rc 0) 00000100:00100000:1.0:1787848412.602823:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10319:x1874694611433856:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 746us (971us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787848412.602830:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:0.0:1787848412.613237:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848412.616824:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611434112 00000100:00100000:3.0:1787848412.616839:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611434112 00000100:00100000:3.0:1787848412.616912:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:3.0:1787848412.616922:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2354:x1874694611434112:12345-192.168.201.26@tcp:1:lfs.0 00010000:00010000:3.0:1787848412.616967:0:11455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.616987:0:11455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.616996:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848412.617000:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787848412.617005:0:11455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.617059:0:11455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848412.617074:0:11455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848412.617091:0:11455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff52192580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11455:1874694631395968:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848412.617206:0:11455:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fcacd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787848412.621529:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848412.621699:0:11455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff52192580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11455:1874694631395968:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848412.621730:0:11455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848412.621969:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611434240 00000100:00100000:2.0:1787848412.621977:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611434240 00002000:00100000:2.0:1787848412.622025:0:6695:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff93ff807e0f00 x1874694611434240/t0(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:118/0 lens 504/0 e 0 to 0 dl 1787848423 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787848412.622035:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff807e0f00 with x1874694611434240 ext(0->12) 00010000:00010000:2.0:1787848412.622043:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 8 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848412.622056:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 8 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787848412.622063:0:6695:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ff807e0f00 00000100:00100000:2.0:1787848412.622096:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:2.0:1787848412.622107:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2351:x1874694611434240:12345-192.168.201.26@tcp:4:lfs.0 00000001:00100000:1.0:1787848412.681570:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00000001:00080000:3.0:1787848412.717153:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1787848412.717314:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611434240:12345-192.168.201.26@tcp:4:lfs.0 Request processed in 95203us (95788us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787848412.717347:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00002000:00100000:0.0:1787848412.717363:0:6695:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff93ff807e0f00 x1874694611434240/t4294967299(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:118/0 lens 504/448 e 0 to 0 dl 1787848423 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787848412.717373:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff807e0f00 with x1874694611434240 ext(0->12) 00010000:00010000:0.0:1787848412.717386:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.717406:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787848412.717414:0:6695:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ff807e0f00 00000100:00100000:1.0:1787848412.725148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848412.725433:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611434368 00000100:00100000:0.0:1787848412.725443:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611434368 00010000:00010000:0.0:1787848412.725485:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848412.725529:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:0.0:1787848412.725540:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2353:x1874694611434368:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848412.725556:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787848412.725578:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787848412.725581:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787848412 00002000:00010000:0.0:1787848412.725583:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787848413 00002000:00010000:0.0:1787848412.725586:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787848412 00002000:00010000:0.0:1787848412.725588:0:5827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1787848412.725609:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.725623:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.725695:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b63f80f/0x9aeb41e0543cb83e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb22e expref: 7 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.725715:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848412.725720:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848412.725727:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.725738:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.725766:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848412.725822:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611434368:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 283us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848412.725830:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00010000:00010000:1.0:1787848412.726303:0:11455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.726315:0:11455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.726356:0:11455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.726365:0:11455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.726373:0:11455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.726393:0:11455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848412.726408:0:11455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.726418:0:11455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.726433:0:11455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.726442:0:11455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035c58f19/0x9aeb41e0543cb88b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848412.726510:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2354:x1874694611434112:12345-192.168.201.26@tcp:1:lfs.0 Request processed in 109588us (113281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848412.726518:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:1.0:1787848412.732259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848412.732348:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611434624 00000100:00100000:0.0:1787848412.732358:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611434624 00000100:00100000:0.0:1787848412.732434:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:0.0:1787848412.732445:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10319:x1874694611434624:12345-192.168.201.26@tcp:35:lfs.0 00000004:00010000:0.0:1787848412.732512:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb87d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb24a expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787848412.732867:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787848412.732929:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787848412.733594:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787848412.733687:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.733706:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb220 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.733715:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.733749:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb220 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.733764:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb220 expref: 23 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848412.733778:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e2940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1874694631396096:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848412.733876:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787848412.737973:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e2940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1874694631396096:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848412.738007:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848412.739029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848412.739349:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611434752 00000100:00100000:2.0:1787848412.739360:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611434752 00010000:00010000:2.0:1787848412.739413:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb220 expref: 24 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848412.739470:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:2.0:1787848412.739481:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:2352:x1874694611434752:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848412.739500:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848412.739522:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb220 expref: 24 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848412.739537:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb220 expref: 24 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848412.739562:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb220 expref: 24 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848412.739578:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:2.0:1787848412.739584:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848412.739594:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848412.739602:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848412.739632:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848412.739735:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:2352:x1874694611434752:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 256us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848412.739744:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 37 00010000:00010000:0.0:1787848412.739857:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.739865:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787848412.740012:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787848412.740356:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787848412.740555:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e2940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874694631396224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787848412.740626:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848412.740693:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787848412.741201:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631396224 00000100:00100000:3.0:1787848412.741210:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631396224 00000100:00100000:3.0:1787848412.741266:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787848412.741274:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874694631396224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787848412.741605:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874694631396224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 332us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848412.741622:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787848412.741665:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787848412.744438:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e2940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874694631396224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787848412.745331:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787848412.745438:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791c0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874694631396352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787848412.745507:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848412.745548:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848412.746606:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631396352 00000100:00100000:2.0:1787848412.746617:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631396352 00000100:00100000:2.0:1787848412.746716:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787848412.746727:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1874694631396352:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787848412.747055:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1874694631396352:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 329us (1547us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787848412.747090:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787848412.747156:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791c0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874694631396352:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787848412.747236:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787848412.747289:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.747300:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.747307:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.747312:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848412.747317:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.747333:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.747350:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:1.0:1787848412.747353:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787848412.747357:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.747363:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb892 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787848412.747547:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787848412.747815:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787848412.747830:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361659189301ns, next at 362659186315ns, rc = 0 00000001:00080000:1.0:1787848412.747838:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787848412.747887:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:1.0:1787848412.747891:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787848412.747908:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb87d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb24a expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848412.748145:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:10319:x1874694611434624:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 15700us (15893us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787848412.748154:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000020:00080000:1.0:1787848412.748158:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787848412.752027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848412.752295:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611434880 00000100:00100000:2.0:1787848412.752305:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611434880 00000100:00100000:2.0:1787848412.752379:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:2.0:1787848412.752391:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:10319:x1874694611434880:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848412.752416:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848412.752438:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb899 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb251 expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848412.752512:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb899 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb251 expref: 27 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848412.752527:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb899 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb251 expref: 27 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848412.752547:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:2.0:1787848412.752550:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787848412.752553:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665200, rc 0) 00000100:00100000:2.0:1787848412.752616:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:10319:x1874694611434880:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 229us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848412.752625:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:3.0:1787848412.758168:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848412.758361:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611435136 00000100:00100000:1.0:1787848412.758372:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611435136 00000100:00100000:1.0:1787848412.758432:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:1.0:1787848412.758442:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff520d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:10319:x1874694611435136:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848412.758731:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff520d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:10319:x1874694611435136:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 290us (572us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787848412.758739:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:3.0:1787848412.876733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848412.876900:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611435392 00000100:00100000:0.0:1787848412.876910:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611435392 00000100:00100000:0.0:1787848412.876976:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:0.0:1787848412.876986:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52192580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:10329:x1874694611435392:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848412.877014:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848412.877046:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb8a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb258 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848412.877154:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787848412.877281:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb8a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb258 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.877297:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:0.0:1787848412.877301:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787848412.877307:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb8a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb258 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.877334:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40031600, rc 0) 00000100:00100000:0.0:1787848412.877405:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52192580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:10329:x1874694611435392:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 420us (683us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787848412.877431:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:3.0:1787848412.882787:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848412.883195:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611435520 00000100:00100000:1.0:1787848412.883206:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611435520 00000100:00100000:1.0:1787848412.883278:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:1.0:1787848412.883288:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff521912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:10329:x1874694611435520:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:1.0:1787848412.883379:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb8ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883396:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb8ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883423:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb8ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883442:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb8b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883464:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883472:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883577:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cb8bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883586:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cb8bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883593:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cb8bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787848412.883862:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cb8bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883877:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb8ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883883:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb8ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883890:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb8ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883896:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42fa00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848412.883900:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb8ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883907:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb8ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883928:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:1.0:1787848412.883932:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848412.883936:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb8ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883942:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cb8ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883955:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883961:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883967:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883973:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848412.883975:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883981:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883988:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff43951300) 00010000:00010000:1.0:1787848412.883990:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848412.883993:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb8b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.883997:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cb8b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.884022:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cb8bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.884028:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cb8bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.884108:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cb8bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.884113:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848412.884117:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cb8bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.884124:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cb8bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.884132:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:1.0:1787848412.884135:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848412.884138:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cb8bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848412.884144:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cb8bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848412.884283:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff521912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:10329:x1874694611435520:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 995us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848412.884292:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:1.0:1787848412.888749:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848412.888864:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611435776 00000100:00100000:2.0:1787848412.888875:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611435776 00000100:00100000:2.0:1787848412.888922:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:2.0:1787848412.888931:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:10329:x1874694611435776:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787848412.889215:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:10329:x1874694611435776:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 284us (476us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787848412.889237:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:3.0:1787848412.960503:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848412.960683:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611436032 00000100:00100000:0.0:1787848412.960693:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611436032 00000100:00100000:0.0:1787848412.960760:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:0.0:1787848412.960771:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:10332:x1874694611436032:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848412.960800:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848412.960823:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb8c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb25f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.960905:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb8ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.960922:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb8ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.960933:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb8ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.960950:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cb8d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.960957:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cb8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.960964:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cb8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961117:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb8d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961138:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961146:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848412.961157:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787848412.961256:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb8ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961264:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb8ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961271:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb8ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961277:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030e00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848412.961281:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb8ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961289:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb8ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961302:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848412.961305:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848412.961310:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb8ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961316:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cb8ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961342:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cb8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961356:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cb8d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961362:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cb8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961367:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848412.961370:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cb8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961376:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cb8d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961385:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff48373600) 00010000:00010000:0.0:1787848412.961388:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848412.961390:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cb8d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961397:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cb8d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961454:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cb8c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb25f expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961468:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb25f expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.961475:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:0.0:1787848412.961477:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848412.961486:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030000, rc 0) 00000100:00100000:0.0:1787848412.961552:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:10332:x1874694611436032:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 782us (1058us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787848412.961561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:3.0:1787848412.967416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848412.967491:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611436160 00000100:00100000:0.0:1787848412.967502:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611436160 00000100:00100000:0.0:1787848412.967553:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:0.0:1787848412.967562:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52191a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:10332:x1874694611436160:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:0.0:1787848412.967661:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cb8e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.967679:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cb8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.967691:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cb8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.967715:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cb8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.967723:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cb8e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.967730:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cb8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.967735:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848412.967739:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cb8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.967747:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cb8e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.967772:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:0.0:1787848412.967775:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787848412.967780:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cb8e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848412.967786:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cb8e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848412.967856:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52191a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:10332:x1874694611436160:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 295us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848412.967863:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:1.0:1787848412.970928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848412.971004:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611436416 00000100:00100000:2.0:1787848412.971015:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611436416 00000100:00100000:2.0:1787848412.971084:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:2.0:1787848412.971095:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:10332:x1874694611436416:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787848412.971359:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+33:10332:x1874694611436416:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 265us (443us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787848412.971368:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00010000:00010000:3.0:1787848413.233665:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848413.405936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848413.406209:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611436672 00000100:00100000:2.0:1787848413.406219:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611436672 00000100:00100000:2.0:1787848413.406322:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:2.0:1787848413.406334:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff521930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+33:10363:x1874694611436672:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:2.0:1787848413.406373:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848413.406397:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb8ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb266 expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.406527:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb8f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.406545:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.406557:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848413.406569:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00080000:0.0:1787848413.406816:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787848413.407058:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb8ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb266 expref: 36 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.407096:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb8f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb266 expref: 35 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.407106:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:2.0:1787848413.407109:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787848413.407113:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664a00, rc 0) 00000100:00100000:2.0:1787848413.407200:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff521930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:10363:x1874694611436672:12345-192.168.201.26@tcp:101:cat.0 Request processed in 868us (1275us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787848413.407208:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:3.0:1787848413.423547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848413.423720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848413.423872:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611437056 00000100:00100000:0.0:1787848413.423885:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611437056 00000100:00100000:0.0:1787848413.423956:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:0.0:1787848413.423968:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff50bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:2351:x1874694611437056:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848413.423985:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848413.424015:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb8f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb266 expref: 35 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848413.424035:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:0.0:1787848413.424041:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848413.424104:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff50bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:2351:x1874694611437056:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 139us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848413.424112:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:2.0:1787848413.428288:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611436928 00000100:00100000:2.0:1787848413.428305:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611436928 00000100:00100000:2.0:1787848413.428409:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787848413.428421:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:10363:x1874694611436928:12345-192.168.201.26@tcp:35:cat.0 00000100:00100000:2.0:1787848413.428858:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:10363:x1874694611436928:12345-192.168.201.26@tcp:35:cat.0 Request processed in 438us (5323us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787848413.428866:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787848413.552062:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631396736:0@lo:400:kworker.0 00000100:00100000:2.0:1787848413.552141:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848413.552216:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787848413.552223:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80748f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631396608:0@lo:400:kworker.0 00000100:00100000:2.0:1787848413.552260:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848413.552279:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631397120:0@lo:400:kworker.0 00000100:00100000:2.0:1787848413.552305:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848413.552351:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631396736 00000100:00100000:2.0:1787848413.552373:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631396736 00000100:00100000:2.0:1787848413.552427:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631396608 00000100:00100000:2.0:1787848413.552430:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631396608 00000100:00100000:0.0:1787848413.552713:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631396864:0@lo:400:kworker.0 00000100:00100000:0.0:1787848413.552746:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848413.552779:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787848413.552785:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff8074b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631396480:0@lo:400:kworker.0 00000100:00100000:0.0:1787848413.552814:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848413.552834:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631396992:0@lo:400:kworker.0 00000100:00100000:0.0:1787848413.552854:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848413.552908:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631396480 00000100:00100000:1.0:1787848413.552917:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631396480 00000100:00100000:1.0:1787848413.552947:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787848413.552955:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631396480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848413.552998:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3312:x1874694631396480:12345-0@lo:400:kworker.0 Request processed in 44us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848413.553004:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787848413.561700:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff8074b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3312:1874694631396480:0@lo:400:kworker.0 00000100:00100000:0.0:1787848413.561757:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631397120 00000100:00100000:0.0:1787848413.561765:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631397120 00000100:00100000:0.0:1787848413.561838:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631396864 00000100:00100000:0.0:1787848413.561842:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631396864 00000100:00100000:0.0:1787848413.561869:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787848413.561878:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631397120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848413.561957:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631397120:12345-0@lo:400:kworker.0 Request processed in 79us (9651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848413.561964:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787848413.561980:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787848413.561986:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874694631396864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848413.562022:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874694631396864:12345-0@lo:400:kworker.0 Request processed in 37us (9276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848413.562028:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787848413.562074:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631397120:0@lo:400:kworker.0 00000100:00100000:0.0:1787848413.562099:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631396864:0@lo:400:kworker.0 00000100:00080000:0.0:1787848413.567883:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787848413.567897:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848413.568170:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631396992 00000100:00100000:2.0:1787848413.568182:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631396992 00000100:00100000:2.0:1787848413.568281:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787848413.568294:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631396736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848413.568409:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631396736:12345-0@lo:400:kworker.0 Request processed in 119us (16268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848413.568415:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787848413.568474:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631396736:0@lo:400:kworker.0 00000100:00100000:2.0:1787848413.568505:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787848413.568513:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631396608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848413.568553:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631396608:12345-0@lo:400:kworker.0 Request processed in 41us (16293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848413.568559:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787848413.568572:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787848413.568578:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631396992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848413.568634:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631396992:12345-0@lo:400:kworker.0 Request processed in 56us (15779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848413.568661:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787848413.568689:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80748f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631396608:0@lo:400:kworker.0 00000100:00100000:2.0:1787848413.568720:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631396992:0@lo:400:kworker.0 00000100:00080000:2.0:1787848413.568767:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848413.627713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848413.631257:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611437312 00000100:00100000:2.0:1787848413.631275:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611437312 00000100:00100000:2.0:1787848413.631374:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:2.0:1787848413.631384:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:10369:x1874694611437312:12345-192.168.201.26@tcp:101:dd.0 00010000:00010000:2.0:1787848413.631411:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848413.631414:0:9224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787848413.631442:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb85a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb23c expref: 35 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.631466:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:2.0:1787848413.631472:0:9224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848413.631486:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb902 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb26d expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.631573:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.631585:0:9224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb8d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb25f expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.631594:0:9224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.631623:0:9224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb25f expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.631636:0:9224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb25f expref: 35 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848413.631707:0:9224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d3840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631397248:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848413.631808:0:9224:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff460eb000 going to sleep for 11 seconds 00000100:00100000:1.0:1787848413.640211:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848413.640357:0:9224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d3840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631397248:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848413.640388:0:9224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848413.640472:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611437440 00000100:00100000:3.0:1787848413.640480:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611437440 00010000:00010000:3.0:1787848413.640521:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb25f expref: 36 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848413.640564:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:3.0:1787848413.640573:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+36:2352:x1874694611437440:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848413.640588:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848413.640595:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb25f expref: 36 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848413.640608:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb25f expref: 36 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848413.640632:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cb8d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb25f expref: 36 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848413.640683:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:3.0:1787848413.640689:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848413.640699:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848413.640718:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848413.640737:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848413.640788:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:2352:x1874694611437440:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 216us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848413.640796:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 38 00010000:00010000:0.0:1787848413.641029:0:9224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848413.641047:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848413.641066:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787848413.641248:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb902 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb26d expref: 37 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848413.641263:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb26d expref: 36 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848413.641271:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:0.0:1787848413.641274:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787848413.641276:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664c00, rc 0) 00000100:00100000:0.0:1787848413.641319:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+36:10369:x1874694611437312:12345-192.168.201.26@tcp:101:dd.0 Request processed in 9937us (13711us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787848413.641326:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:1.0:1787848413.650975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848413.651448:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611437696 00000100:00100000:3.0:1787848413.651464:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611437696 00000100:00100000:3.0:1787848413.652625:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:3.0:1787848413.652669:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:10369:x1874694611437696:12345-192.168.201.26@tcp:36:dd.0 00010000:00010000:3.0:1787848413.653086:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb917 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848413.653109:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848413.653124:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787848413.653186:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787848413.653226:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000682fa492 reply state 000000002d3ace44 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848413.653237:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787848413.653418:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:10369:x1874694611437696:12345-192.168.201.26@tcp:36:dd.0 Request processed in 778us (2459us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787848413.653427:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 52 00000020:00080000:3.0:1787848413.653432:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787848413.659430:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.659455:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb917 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.659464:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.659471:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848413.659476:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.659485:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb917 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.659509:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:2.0:1787848413.659513:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848413.659520:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb917 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848413.659527:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb917 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848413.999347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848413.999697:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611437824 00000100:00100000:3.0:1787848413.999712:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611437824 00000100:00100000:3.0:1787848413.999948:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:3.0:1787848413.999961:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+37:10383:x1874694611437824:12345-192.168.201.26@tcp:101:stat.0 00010000:00010000:3.0:1787848414.000001:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848414.000034:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cb91e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb274 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.000126:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cb925 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.000145:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cb925 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.000159:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cb925 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.000340:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cb92c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.000368:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cb92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.000381:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cb92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.000714:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.000730:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb26d expref: 38 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.000762:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.000809:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb26d expref: 38 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.000826:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb26d expref: 38 pid: 9224 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848414.000842:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631397376:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848414.001988:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848414.026171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848414.026386:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611438080 00000100:00100000:2.0:1787848414.026403:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611438080 00000100:00100000:2.0:1787848414.026512:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:2.0:1787848414.026523:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+39:5594:x1874694611438080:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787848414.027145:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+40:5594:x1874694611438080:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 618us (980us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787848414.027155:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:3.0:1787848414.028355:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631397376:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848414.028391:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848414.037368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848414.037485:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611438208 00000100:00100000:0.0:1787848414.037497:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611438208 00010000:00010000:0.0:1787848414.037555:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb26d expref: 40 pid: 9224 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848414.037605:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:0.0:1787848414.037835:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+40:2353:x1874694611438208:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848414.037855:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848414.037864:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb26d expref: 40 pid: 9224 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.037898:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb26d expref: 40 pid: 9224 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.037933:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb909 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb26d expref: 40 pid: 9224 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.037950:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:0.0:1787848414.037957:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.037966:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.037975:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.038003:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848414.038197:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+39:2353:x1874694611438208:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 584us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848414.038208:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 39 00010000:00010000:1.0:1787848414.039181:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039193:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848414.039242:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787848414.039247:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848414.039293:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039318:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039328:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cb925 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039334:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cb925 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039355:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cb925 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039361:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848414.039365:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cb925 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039373:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cb925 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039385:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:1.0:1787848414.039388:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848414.039392:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cb925 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039398:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cb925 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039414:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cb92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039420:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cb92c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039426:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cb92c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039430:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848414.039433:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cb92c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039448:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cb92c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039455:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff541a1100) 00010000:00010000:1.0:1787848414.039457:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848414.039460:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cb92c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039465:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cb92c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.039993:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cb91e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb274 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.040015:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb274 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.040585:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:1.0:1787848414.040588:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787848414.040796:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236600, rc 0) 00000100:00100000:1.0:1787848414.040959:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:10383:x1874694611437824:12345-192.168.201.26@tcp:101:stat.0 Request processed in 40998us (41671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848414.040969:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 53 00000004:00080000:1.0:1787848414.065264:0:6883:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362976621471ns, next at 363976618462ns, rc = 0 00000100:00100000:2.0:1787848414.065438:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631397632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848414.065524:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848414.065584:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631397632 00000100:00100000:2.0:1787848414.065592:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631397632 00000100:00100000:2.0:1787848414.065664:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787848414.065674:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631397632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848414.065727:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848414.065772:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631397632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848414.065779:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787848414.065827:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631397632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848414.066005:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787848414.066016:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631397504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848414.066059:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848414.066247:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631397504 00000100:00100000:2.0:1787848414.066251:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631397504 00000100:00100000:2.0:1787848414.066311:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787848414.066320:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631397504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848414.066333:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787848414.066369:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631397504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848414.066376:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787848414.066408:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631397504:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787848414.068375:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787848414.154227:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848414.154349:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611438464 00000100:00100000:0.0:1787848414.154360:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611438464 00000100:00100000:0.0:1787848414.154429:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:0.0:1787848414.154440:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79441680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:10389:x1874694611438464:12345-192.168.201.26@tcp:36:truncate.0 00010000:00010000:0.0:1787848414.154608:0:9224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848414.154678:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cb933 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb274 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.154700:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:0.0:1787848414.154705:0:9224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787848414.154958:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cb93a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.154971:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cb93a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.154983:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cb93a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787848414.155165:0:9224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787848414.155191:0:9224:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000beb6aeb5 reply state 000000009b770f94 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cb93a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848414.155200:0:9224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787848414.155324:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79441680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+40:10389:x1874694611438464:12345-192.168.201.26@tcp:36:truncate.0 Request processed in 884us (1104us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787848414.155333:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 54 00000020:00080000:0.0:1787848414.155338:0:9224:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787848414.175634:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cb93a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.175833:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cb93a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.175842:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cb93a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.175849:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848414.175854:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cb93a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.175887:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cb93a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.175975:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:3.0:1787848414.175979:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848414.175985:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cb93a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.175990:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cb93a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.256720:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848414.332031:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848414.332127:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611438592 00000100:00100000:3.0:1787848414.332137:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611438592 00000100:00100000:3.0:1787848414.332204:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:3.0:1787848414.332215:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79442d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+39:10403:x1874694611438592:12345-192.168.201.26@tcp:101:stat.0 00010000:00010000:3.0:1787848414.332241:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848414.332263:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb941 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb27b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332342:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb948 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332357:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb948 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332380:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb948 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332397:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb94f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332423:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb94f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332432:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb94f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332544:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332553:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332561:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848414.332594:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787848414.332599:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848414.332622:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332634:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332691:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb948 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332698:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb948 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332705:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb948 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332721:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848414.332726:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb948 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332734:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb948 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332746:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:3.0:1787848414.332749:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848414.332754:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb948 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332760:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cb948 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332775:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb94f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332782:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb94f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332788:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb94f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332793:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848414.332796:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb94f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332803:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb94f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332819:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff541a1000) 00010000:00010000:3.0:1787848414.332822:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848414.332825:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb94f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332832:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb94f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332861:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb941 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb27b expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332874:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb27b expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.332882:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:3.0:1787848414.332884:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848414.332887:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237400, rc 0) 00000100:00100000:3.0:1787848414.332952:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79442d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+40:10403:x1874694611438592:12345-192.168.201.26@tcp:101:stat.0 Request processed in 739us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848414.332960:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:1.0:1787848414.455471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848414.455692:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611438848 00000100:00100000:3.0:1787848414.455706:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611438848 00000100:00100000:3.0:1787848414.455804:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:3.0:1787848414.455818:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79443840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+40:10413:x1874694611438848:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848414.455847:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848414.455877:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb95d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb282 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848414.456052:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787848414.456232:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb95d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb282 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.456250:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:3.0:1787848414.456254:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787848414.456261:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb95d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb282 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.456282:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237c00, rc 0) 00000100:00100000:3.0:1787848414.456381:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79443840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+41:10413:x1874694611438848:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 565us (926us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787848414.456390:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:2.0:1787848414.459551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848414.461365:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611439104 00000100:00100000:0.0:1787848414.461387:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611439104 00000100:00100000:0.0:1787848414.461551:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:0.0:1787848414.461566:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+41:10413:x1874694611439104:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:0.0:1787848414.462015:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+42:10413:x1874694611439104:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 452us (2475us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787848414.462052:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:1.0:1787848414.632864:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848414.633136:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611439360 00000100:00100000:3.0:1787848414.633151:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611439360 00000100:00100000:3.0:1787848414.633246:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:3.0:1787848414.633259:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79440780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+42:10419:x1874694611439360:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787848414.633330:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848414.633362:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb96b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb289 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.633551:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.633570:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb27b expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.633594:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.634450:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb27b expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.634473:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb27b expref: 43 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848414.634491:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631397760:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848414.635530:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787848414.651493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848414.652665:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631397760:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848414.652708:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848414.653211:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611439488 00000100:00100000:2.0:1787848414.653222:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611439488 00010000:00010000:2.0:1787848414.653282:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb27b expref: 44 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848414.653530:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:2.0:1787848414.653555:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79442580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+44:2351:x1874694611439488:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848414.653579:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848414.653588:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb27b expref: 44 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.653611:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb27b expref: 44 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.653676:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cb956 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb27b expref: 44 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.653697:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:2.0:1787848414.653701:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.653721:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.653736:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.653765:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848414.653852:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79442580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+43:2351:x1874694611439488:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 300us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848414.653860:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 40 00010000:00010000:3.0:1787848414.655117:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.655137:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848414.655176:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787848414.655424:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cb96b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb289 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.655448:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb289 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848414.655482:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:3.0:1787848414.655486:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787848414.655489:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236c00, rc 0) 00000100:00100000:3.0:1787848414.655582:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79440780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+43:10419:x1874694611439360:12345-192.168.201.26@tcp:101:bash.0 Request processed in 22325us (22735us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787848414.655593:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:1.0:1787848414.662181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848414.663444:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611439744 00000100:00100000:0.0:1787848414.663463:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611439744 00000100:00100000:0.0:1787848414.663565:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:0.0:1787848414.663579:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+43:10419:x1874694611439744:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:0.0:1787848414.664242:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cb980 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.664269:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cb980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.664285:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cb980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787848414.665519:0:7097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787848414.665579:0:7097:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015851b07 reply state 000000003369d0b5 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cb980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848414.665592:0:7097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787848414.667574:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+46:10419:x1874694611439744:12345-192.168.201.26@tcp:36:bash.0 Request processed in 3979us (5389us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787848414.667593:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 58 00000020:00080000:0.0:1787848414.667605:0:7097:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787848414.675302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848414.675435:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611439872 00000100:00100000:0.0:1787848414.675449:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611439872 00010000:00010000:2.0:1787848414.675492:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cb980 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.675506:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cb980 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.675514:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cb980 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.675520:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148d400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848414.675527:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cb980 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.675536:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cb980 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848414.675538:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:0.0:1787848414.675550:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79441e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+46:10419:x1874694611439872:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787848414.675558:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:2.0:1787848414.675561:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848414.675568:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cb980 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.675574:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cb980 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.675583:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848414.675625:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb987 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb290 expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.676244:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cb98e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.676266:0:9224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb289 expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.676276:0:9224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cb98e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.676348:0:9224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb289 expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.676366:0:9224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb289 expref: 46 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848414.676384:0:9224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79441a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631397888:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787848414.676509:0:9224:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff504ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1787848414.691854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848414.691994:0:9224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79441a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631397888:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848414.692040:0:9224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cb98e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848414.692207:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611440000 00000100:00100000:0.0:1787848414.692217:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611440000 00010000:00010000:0.0:1787848414.692269:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb289 expref: 47 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848414.692332:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:0.0:1787848414.692343:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+47:2352:x1874694611440000:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848414.692365:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848414.692374:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb289 expref: 47 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.692387:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb289 expref: 47 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.692432:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cb972 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb289 expref: 47 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.692452:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:0.0:1787848414.692459:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cb98e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.692470:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cb98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.692481:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cb98e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.692582:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848414.692715:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+46:2352:x1874694611440000:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 372us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848414.692725:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 41 00010000:00010000:2.0:1787848414.705269:0:9224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cb98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.705332:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cb98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848414.705605:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787848414.705612:0:9224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848414.705841:0:9224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cb98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.705899:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb987 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb290 expref: 46 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.705948:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cb98e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb290 expref: 45 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.705958:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:1.0:1787848414.705961:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787848414.705966:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e000, rc 0) 00000100:00100000:1.0:1787848414.706082:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79441e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+45:10419:x1874694611439872:12345-192.168.201.26@tcp:101:bash.0 Request processed in 30533us (30809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848414.706094:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:1.0:1787848414.709728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848414.709876:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611440256 00000100:00100000:0.0:1787848414.709891:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611440256 00000100:00100000:0.0:1787848414.709972:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:0.0:1787848414.709984:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff520d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+45:10419:x1874694611440256:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:0.0:1787848414.710396:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff520d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+46:10419:x1874694611440256:12345-192.168.201.26@tcp:35:bash.0 Request processed in 414us (686us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787848414.710406:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:3.0:1787848414.822936:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848414.823853:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611440512 00000100:00100000:0.0:1787848414.823873:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611440512 00000100:00100000:0.0:1787848414.824020:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:0.0:1787848414.824037:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+46:10429:x1874694611440512:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848414.824075:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848414.824105:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb995 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb297 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848414.824271:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787848414.824467:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb995 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb297 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.824488:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:0.0:1787848414.824492:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787848414.824521:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb995 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb297 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.824542:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c600, rc 0) 00000100:00100000:0.0:1787848414.825011:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+47:10429:x1874694611440512:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 978us (2092us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787848414.825022:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:1.0:1787848414.837060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848414.837298:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611440640 00000100:00100000:0.0:1787848414.837313:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611440640 00000100:00100000:0.0:1787848414.837436:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:0.0:1787848414.837451:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79442940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+47:10429:x1874694611440640:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:0.0:1787848414.837571:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cb9a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.837612:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cb9a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.837626:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cb9a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.837681:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb9aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.837690:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb9aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.837697:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb9aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.837953:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.837984:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.837992:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787848414.838052:0:7097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838069:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cb9a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838077:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cb9a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838084:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cb9a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838091:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148da00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848414.838095:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cb9a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838103:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cb9a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838118:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848414.838121:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848414.838126:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cb9a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838134:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cb9a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838157:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb9aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838164:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb9aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838170:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb9aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838175:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848414.838178:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb9aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838183:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb9aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838192:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff48373600) 00010000:00010000:0.0:1787848414.838194:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848414.838198:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb9aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838203:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cb9aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838222:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838229:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838235:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838247:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148ca00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848414.838250:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838255:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838263:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:0.0:1787848414.838265:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848414.838269:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.838274:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848414.838457:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79442940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+47:10429:x1874694611440640:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 1007us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848414.838468:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:2.0:1787848414.842453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848414.842544:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611440896 00000100:00100000:0.0:1787848414.842557:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611440896 00000100:00100000:0.0:1787848414.843147:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:0.0:1787848414.843161:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+47:10429:x1874694611440896:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:0.0:1787848414.843535:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+48:10429:x1874694611440896:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 377us (1096us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787848414.843544:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:1.0:1787848414.889635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848414.890013:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611441152 00000100:00100000:2.0:1787848414.890029:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611441152 00000100:00100000:2.0:1787848414.890114:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:2.0:1787848414.890125:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79440b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+48:10432:x1874694611441152:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848414.890158:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848414.890188:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb9b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb29e expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.890280:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.890310:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.890324:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.890342:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.890349:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.890356:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891194:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cb9cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891208:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cb9cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891219:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cb9cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848414.891231:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787848414.891836:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891846:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891853:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891860:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848414.891865:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891872:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891889:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:2.0:1787848414.891892:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848414.891898:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891923:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891942:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891947:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891953:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891957:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848414.891960:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891966:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891975:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff53a89e00) 00010000:00010000:2.0:1787848414.891977:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848414.891980:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.891985:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.892050:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cb9b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb29e expref: 51 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.892067:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cb9cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb29e expref: 50 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848414.892086:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:2.0:1787848414.892088:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787848414.892090:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665a00, rc 0) 00000100:00100000:2.0:1787848414.892283:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79440b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+50:10432:x1874694611441152:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 2158us (2662us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787848414.892306:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:2.0:1787848414.900064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848414.900123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848414.900232:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611441408 00000100:00100000:0.0:1787848414.900245:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611441408 00000100:00100000:0.0:1787848414.900327:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:0.0:1787848414.900356:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+50:10432:x1874694611441408:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:0.0:1787848414.900454:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.900474:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.900487:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.900520:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.900527:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.900535:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.900541:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148ca00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848414.900546:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.900554:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.900566:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:0.0:1787848414.900569:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787848414.901112:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848414.901125:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848414.901234:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+50:10432:x1874694611441408:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 879us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848414.901243:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:1.0:1787848414.902002:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611441280 00000100:00100000:1.0:1787848414.902012:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611441280 00000100:00100000:1.0:1787848414.902070:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:1.0:1787848414.902080:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+50:2351:x1874694611441280:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848414.902097:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848414.902123:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cb9cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb29e expref: 50 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848414.902140:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:1.0:1787848414.902145:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848414.902193:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+49:2351:x1874694611441280:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 114us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848414.902200:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:2.0:1787848414.909094:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848414.909189:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611441664 00000100:00100000:1.0:1787848414.909203:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611441664 00000100:00100000:1.0:1787848414.909334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:1.0:1787848414.909349:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+49:10432:x1874694611441664:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848414.910111:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+50:10432:x1874694611441664:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 759us (1025us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787848414.910123:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:3.0:1787848415.084118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848415.084273:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611441920 00000100:00100000:0.0:1787848415.084300:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611441920 00000100:00100000:0.0:1787848415.084407:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:0.0:1787848415.084422:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+50:10450:x1874694611441920:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:0.0:1787848415.084458:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848415.084488:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2a5 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787848415.084831:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787848415.085181:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cb9e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.085202:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cb9e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.085218:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cb9e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848415.085232:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787848415.085455:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cb9e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2a5 expref: 53 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.085483:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cb9e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2a5 expref: 52 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.085493:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:1.0:1787848415.085497:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787848415.085501:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42ee00, rc 0) 00000100:00100000:1.0:1787848415.085600:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+52:10450:x1874694611441920:12345-192.168.201.26@tcp:101:cat.0 Request processed in 1175us (1492us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787848415.085610:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:3.0:1787848415.135505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848415.136087:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611442048 00000100:00100000:2.0:1787848415.136106:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611442048 00000100:00100000:2.0:1787848415.136247:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:2.0:1787848415.136266:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+52:10451:x1874694611442048:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848415.136324:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848415.136359:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2ac expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.136475:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.136497:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.136518:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848415.137169:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787848415.137177:0:9224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787848415.137269:0:9224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.137338:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cb9f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2ac expref: 54 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.137370:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2ac expref: 53 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.137384:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:2.0:1787848415.137388:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787848415.137393:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664000, rc 0) 00000100:00100000:2.0:1787848415.137859:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+53:10451:x1874694611442048:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1595us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848415.137869:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:2.0:1787848415.145956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848415.146035:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611442432 00000100:00100000:0.0:1787848415.146050:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611442432 00000100:00100000:0.0:1787848415.146128:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:0.0:1787848415.146139:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+53:10451:x1874694611442432:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848415.148008:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:10451:x1874694611442432:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 1857us (2054us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787848415.148024:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:1.0:1787848415.154140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848415.155572:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611442560 00000100:00100000:2.0:1787848415.155588:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611442560 00000100:00100000:2.0:1787848415.156443:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:2.0:1787848415.156460:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:10451:x1874694611442560:12345-192.168.201.26@tcp:103:lfs.0 00010000:00010000:2.0:1787848415.156480:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787848415.156687:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cb98e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb290 expref: 54 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.156718:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cb9e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2a5 expref: 53 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.156753:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cb899 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb251 expref: 52 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.156765:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:2.0:1787848415.156780:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848415.156853:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+51:10451:x1874694611442560:12345-192.168.201.26@tcp:103:lfs.0 Request processed in 399us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848415.156861:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:3.0:1787848415.166783:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848415.167125:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611442688 00000100:00100000:0.0:1787848415.167138:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611442688 00000100:00100000:0.0:1787848415.167203:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 66 00000100:00100000:0.0:1787848415.167294:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+51:10451:x1874694611442688:12345-192.168.201.26@tcp:58:lfs.0 00010000:00010000:0.0:1787848415.167437:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cba05 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.167455:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cba05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.167468:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cba05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787848415.174187:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787848415.174405:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787848415.174594:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787848415.174774:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+51:10451:x1874694611442688:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 7552us (7993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848415.174789:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 66 00000001:00080000:1.0:1787848415.207344:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967346 is committed 00000001:00080000:1.0:1787848415.207403:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:1.0:1787848415.207412:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1787848415.207425:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787848415.207434:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ff802f8300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787848415.207439:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff6ecec300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ff802f80c0 00000020:00080000:1.0:1787848415.207442:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff6ececb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ff7b990000 00000020:00080000:1.0:1787848415.208013:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787848415.208130:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787848415.208151:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79443c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631398016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787848415.208308:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848415.208405:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631398016 00000100:00100000:1.0:1787848415.208415:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631398016 00000100:00100000:1.0:1787848415.208475:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787848415.208483:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631398016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787848415.208513:0:6690:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787848415.208548:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9066dc, atime: 0x6a9066dd, ctime: 0x6a9066dc, blocks: 0xb 00010000:00010000:1.0:1787848415.208557:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cba0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.208943:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1787848415.208950:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848415.208958:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cba0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.208992:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cba0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.209004:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cba0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.209013:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cba0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.209082:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787848415.210098:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874694631398016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1611us (1786us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787848415.210110:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1787848415.210353:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff79443c00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787848415.210360:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79443c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631398016:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787848415.218976:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848415.218992:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cba0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.219008:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ee00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848415.219013:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cba0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.219026:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cba0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.219073:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cba0c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.219082:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cba0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.224976:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848415.224985:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848415.224988:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848415.245832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848415.245970:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611442816 00000100:00100000:3.0:1787848415.245982:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611442816 00000100:00100000:3.0:1787848415.246048:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 67 00000100:00100000:3.0:1787848415.246059:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+11:10453:x1874694611442816:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848415.246080:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848415.246101:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.246169:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cba1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.246183:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cba1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.246194:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cba1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.246207:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.246225:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.246254:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.246604:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.246614:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.247024:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848415.247159:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787848415.247165:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787848415.247187:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247261:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247271:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cba1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247286:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cba1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247294:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cba1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247299:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848415.247312:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cba1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247320:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cba1a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247335:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:2.0:1787848415.247338:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848415.247343:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cba1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247350:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cba1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247367:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247374:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247380:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247385:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236e00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848415.247388:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247393:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247400:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff541a1000) 00010000:00010000:2.0:1787848415.247402:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848415.247411:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247417:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247458:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2b3 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247474:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2b3 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.247481:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff48373600) 00010000:00010000:2.0:1787848415.247483:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787848415.247485:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236400, rc 0) 00000100:00100000:2.0:1787848415.248615:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:10453:x1874694611442816:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 2550us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848415.248636:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 67 00010000:00010000:1.0:1787848415.284071:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787848415.793323:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787848415.793334:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787848415.793389:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787848415.793397:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787848415.793531:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff8074b840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631398144:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787848415.793685:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463fd840 going to sleep for 11 seconds 00000100:00100000:2.0:1787848415.803296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848415.803397:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff8074b840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631398144:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787848415.803617:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611442944 00000100:00100000:1.0:1787848415.803624:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611442944 00000100:00100000:1.0:1787848415.803720:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:1.0:1787848415.803730:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:10464:x1874694611442944:12345-192.168.201.26@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787848415.803814:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:10464:x1874694611442944:12345-192.168.201.26@tcp:900:lhsmtool_posix.0 Request processed in 85us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848415.803822:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:2.0:1787848415.826813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848415.826879:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611443072 00000100:00100000:2.0:1787848415.826891:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611443072 00000100:00100000:2.0:1787848415.826951:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:2.0:1787848415.826961:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:10464:x1874694611443072:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787848415.827008:0:9224:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787848415.827516:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:10464:x1874694611443072:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 554us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848415.827525:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:0.0:1787848415.862258:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848415.862736:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611443200 00000100:00100000:3.0:1787848415.862749:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611443200 00000100:00100000:3.0:1787848415.862813:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:3.0:1787848415.862827:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:10464:x1874694611443200:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787848415.862992:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cba2f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863011:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cba2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863025:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cba2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863056:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba36 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863064:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863408:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863439:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863446:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863453:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848415.863488:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787848415.863492:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848415.863504:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863517:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cba2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863523:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cba2f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863529:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cba2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863535:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848415.863540:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cba2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863547:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cba2f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863564:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:3.0:1787848415.863567:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848415.863572:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cba2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863578:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cba2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863593:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863599:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba36 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863604:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863608:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848415.863610:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863616:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba36 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863622:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff93ff541a1100) 00010000:00010000:3.0:1787848415.863624:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848415.863627:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba36 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863632:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cba36 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863791:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863797:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863803:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863808:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236e00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848415.863811:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863817:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863825:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff48373600) 00010000:00010000:3.0:1787848415.863827:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848415.863831:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.863836:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cba3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848415.864238:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:10464:x1874694611443200:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 Request processed in 1410us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848415.864248:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:3.0:1787848415.879510:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848415.879973:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611443456 00000100:00100000:2.0:1787848415.880742:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611443456 00000100:00100000:2.0:1787848415.880817:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:2.0:1787848415.880828:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:10464:x1874694611443456:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848415.880853:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848415.880884:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cba44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2ba expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.883297:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cba4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.883324:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cba4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.883338:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cba4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848415.883357:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787848415.883697:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cba4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.883706:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cba4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.883713:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cba4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.883718:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848415.883722:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cba4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.883728:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cba4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.883740:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff48373600) 00010000:00010000:0.0:1787848415.883742:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848415.883755:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cba4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.883761:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cba4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.883811:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cba44 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2ba expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.883823:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:0.0:1787848415.883825:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787848415.883829:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cba44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2ba expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.883839:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665200, rc 0) 00000100:00100000:0.0:1787848415.884612:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10464:x1874694611443456:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 3782us (5110us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787848415.884624:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:0.0:1787848415.890215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848415.890262:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611443584 00000100:00100000:2.0:1787848415.890285:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611443584 00000100:00100000:2.0:1787848415.890354:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00100000:2.0:1787848415.890365:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10464:x1874694611443584:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787848415.890406:0:7097:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787848415.890528:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10464:x1874694611443584:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 165us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848415.890536:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00100000:3.0:1787848415.895355:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848415.895703:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611443840 00000100:00100000:1.0:1787848415.895717:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611443840 00000100:00100000:1.0:1787848415.895792:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00100000:1.0:1787848415.895815:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10464:x1874694611443840:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787848415.895838:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848415.895841:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787848415.895876:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cb9fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2ac expref: 13 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.895895:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:1.0:1787848415.895900:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787848415.895914:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cba59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2c1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787848415.896778:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787848415.897047:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cba60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.897062:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cba60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.897084:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cba60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.897142:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cba59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c1 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.898959:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cba60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c1 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848415.899960:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff43951000) 00010000:00010000:1.0:1787848415.899968:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787848415.899999:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f800, rc 0) 00000100:00100000:1.0:1787848415.900379:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10464:x1874694611443840:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 4563us (5029us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787848415.900389:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00100000:3.0:1787848415.909205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848415.909312:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611444096 00000100:00100000:2.0:1787848415.909322:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611444096 00000100:00100000:2.0:1787848415.909386:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 73 00000100:00100000:2.0:1787848415.909404:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10464:x1874694611444096:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787848415.909460:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848415.909485:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cba60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c1 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909504:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff43951000) 00010000:00010000:2.0:1787848415.909513:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848415.909533:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909546:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909556:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909568:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xcc018b59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909575:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc018b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909593:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc018b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909848:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909857:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909872:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909879:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848415.909883:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909890:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909900:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:2.0:1787848415.909902:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848415.909906:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909912:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909922:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc018b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909928:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc018b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909934:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc018b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909939:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665e00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848415.909942:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc018b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909956:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc018b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909964:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xcc018b59 (ffff93ff53a89200) 00010000:00010000:2.0:1787848415.909966:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848415.909968:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcc018b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.909975:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcc018b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848415.910051:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10464:x1874694611444096:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 649us (854us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787848415.910058:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 73 00000100:00100000:0.0:1787848415.925471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848415.925513:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611444224 00000100:00100000:0.0:1787848415.925523:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611444224 00000100:00100000:0.0:1787848415.930436:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00100000:0.0:1787848415.930465:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10464:x1874694611444224:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787848415.930489:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848415.930514:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cba7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2c8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.930555:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cba83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.930596:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cba83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.930608:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cba83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.930726:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cba7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c8 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.930745:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cba83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c8 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848415.930754:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff48373800) 00010000:00010000:0.0:1787848415.930757:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787848415.930760:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c800, rc 0) 00000100:00100000:0.0:1787848415.930844:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10464:x1874694611444224:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 392us (5381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848415.930850:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00100000:1.0:1787848415.941689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848415.941732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848415.941762:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848415.941789:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611444608 00000100:00100000:1.0:1787848415.941798:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611444608 00000100:00100000:1.0:1787848415.941850:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 299 00000100:00100000:1.0:1787848415.941859:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611444608:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848415.941929:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611444608:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 71us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848415.941938:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 299 00000100:00100000:1.0:1787848415.942002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848415.942424:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611444480 00000100:00100000:2.0:1787848415.942430:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611444480 00000100:00100000:2.0:1787848415.942496:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611444864 00000100:00100000:2.0:1787848415.942499:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611444864 00000100:00100000:2.0:1787848415.942532:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 161 00000100:00100000:2.0:1787848415.942539:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611444864:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848415.942578:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2352:x1874694611444864:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 40us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848415.942584:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 161 00000100:00100000:2.0:1787848415.942597:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 75 00000100:00100000:2.0:1787848415.942603:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10464:x1874694611444480:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787848415.942700:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.942731:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.942744:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787848415.943036:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1787848415.943048:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364854407236ns, next at 365854404059ns, rc = 0 00000004:00010000:2.0:1787848415.943150:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009095798 reply state 00000000211471d8 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848415.943160:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787848415.943222:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:10464:x1874694611444480:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 617us (1542us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787848415.943228:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 75 00000100:00100000:0.0:1787848415.944462:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611444736 00000100:00100000:0.0:1787848415.944472:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611444736 00000100:00100000:0.0:1787848415.944529:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 88 00000100:00100000:0.0:1787848415.944539:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611444736:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848415.944589:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611444736:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 52us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848415.944596:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 88 00000100:00080000:1.0:1787848415.946360:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787848415.946371:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848415.962342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848415.962374:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611444992 00000100:00100000:2.0:1787848415.962385:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611444992 00000100:00100000:2.0:1787848415.962437:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 76 00000100:00100000:2.0:1787848415.962449:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:10464:x1874694611444992:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848415.962473:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848415.962494:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2cf expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.962556:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2cf expref: 17 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.962571:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2cf expref: 17 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848415.962598:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff48373800) 00010000:00010000:2.0:1787848415.962601:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787848415.962606:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664200, rc 0) 00010000:00010000:3.0:1787848415.962943:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.962953:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.962960:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.962966:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665e00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848415.962971:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.962978:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.962991:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff48373800) 00010000:00010000:3.0:1787848415.962993:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787848415.962998:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848415.963004:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cba8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848415.963766:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:10464:x1874694611444992:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 1313us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848415.963776:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 76 00000100:00100000:2.0:1787848415.979869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848415.981452:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611445120 00000100:00100000:0.0:1787848415.981470:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611445120 00000100:00100000:0.0:1787848415.981539:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:0.0:1787848415.981551:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1874694611445120:12345-192.168.201.26@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787848415.981599:0:6690:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:0.0:1787848415.981652:0:6690:0:(genops.c:1385:class_connect()) connect: client 8bb0bb0f-4511-40a8-bdfa-25f441891529, cookie 0x9aeb41e0543cba98 00002000:00100000:0.0:1787848415.981682:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8bb0bb0f-4511-40a8-bdfa-25f441891529/ffff93ff5f537000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787848415.981714:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787848415.981994:0:6690:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787848415.982028:0:6690:0:(import.c:65:import_set_state_nolock()) ffff93ff5f532800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787848415.982122:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2350:x1874694611445120:12345-192.168.201.26@tcp:8:lhsmtool_posix.0 Request processed in 572us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848415.982131:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:2.0:1787848415.988028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848415.988158:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611445248 00000100:00100000:0.0:1787848415.988169:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611445248 00000100:00100000:0.0:1787848415.988244:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:0.0:1787848415.988254:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:0:x1874694611445248:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787848415.989486:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787848416.080424:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:0:x1874694611445248:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 92158us (92396us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787848416.080439:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 26 00000001:00080000:0.0:1787848416.080958:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1787848416.080968:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00000100:00100000:0.0:1787848416.091911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848416.095579:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611445504 00000100:00100000:1.0:1787848416.095597:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611445504 00000100:00100000:1.0:1787848416.095842:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:1.0:1787848416.095853:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:10464:x1874694611445504:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787848416.096141:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:10464:x1874694611445504:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 289us (4237us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787848416.096149:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:0.0:1787848416.100381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848416.100920:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611445760 00000100:00100000:1.0:1787848416.100932:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611445760 00000100:00100000:0.0:1787848416.101114:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00100000:0.0:1787848416.101128:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:10464:x1874694611445760:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787848416.101271:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:10464:x1874694611445760:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 139us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848416.101279:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00100000:3.0:1787848416.117636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848416.117710:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611445888 00000100:00100000:2.0:1787848416.117722:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611445888 00000100:00100000:2.0:1787848416.117783:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 78 00000100:00100000:2.0:1787848416.117793:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:10464:x1874694611445888:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848416.117818:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848416.117847:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cba9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2d6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.117924:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbaa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.117939:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbaa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.117953:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbaa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848416.117991:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787848416.118042:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbaa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.118073:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cba9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2d6 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.118098:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbaa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2d6 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.118108:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff48373800) 00010000:00010000:2.0:1787848416.118111:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787848416.118115:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664000, rc 0) 00000100:00100000:2.0:1787848416.118174:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10464:x1874694611445888:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 382us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848416.118180:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 78 00000100:00100000:3.0:1787848416.132881:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848416.132971:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611446016 00000100:00100000:1.0:1787848416.132987:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611446016 00000100:00100000:1.0:1787848416.133056:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:1.0:1787848416.133067:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2351:x1874694611446016:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787848416.133084:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848416.133109:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbaad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2dd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787848416.133135:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9066e0, blocks: 0x1 00010000:00010000:1.0:1787848416.133156:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1787848416.133160:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848416.133172:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbaad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2dd expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848416.133193:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbaad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2dd expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848416.133205:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42ec00, rc 0) 00000100:00100000:1.0:1787848416.133279:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611446016:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 215us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848416.133286:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:0.0:1787848416.142172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848416.148491:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611446272 00000100:00100000:2.0:1787848416.148509:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611446272 00000100:00100000:3.0:1787848416.148735:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:3.0:1787848416.148747:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10464:x1874694611446272:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787848416.148878:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10464:x1874694611446272:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 134us (6716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848416.148886:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:0.0:1787848416.157336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848416.157436:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611446400 00000100:00100000:3.0:1787848416.157449:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611446400 00000100:00100000:3.0:1787848416.157513:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:3.0:1787848416.157523:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:10464:x1874694611446400:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787848416.157541:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848416.157560:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2e4 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.157594:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbaad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2dd expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.157604:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848416.157608:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848416.157613:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.157679:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbaad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2dd expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.157695:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbaad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2dd expref: 7 pid: 6690 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848416.157709:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874694631398272:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848416.157813:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787848416.161279:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874694631398272:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848416.161317:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.161357:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237c00, rc 0) 00000100:00100000:3.0:1787848416.161421:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:10464:x1874694611446400:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 3899us (4097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848416.161430:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:1.0:1787848416.163115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848416.163200:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611446528 00000100:00100000:0.0:1787848416.163208:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611446528 00010000:00010000:0.0:1787848416.163247:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbaad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2dd expref: 7 pid: 6690 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848416.163300:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:0.0:1787848416.163310:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff50bb6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611446528:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848416.163324:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848416.163347:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbaad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2dd expref: 7 pid: 6690 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.163363:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbaad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2dd expref: 7 pid: 6690 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.163391:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbaad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2dd expref: 7 pid: 6690 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.163409:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848416.163414:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848416.163421:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.163445:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.163482:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848416.163495:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f40e1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1874694631398400:192.168.201.26@tcp:105: 00000100:00100000:0.0:1787848416.163582:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff583d9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848416.168988:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f40e1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1874694631398400:192.168.201.26@tcp:105: 00010000:00010000:1.0:1787848416.169016:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848416.169084:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff50bb6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611446528:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 5774us (5975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848416.169098:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:1.0:1787848416.216697:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848416.224049:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611446656 00000100:00100000:3.0:1787848416.224065:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611446656 00002000:00100000:3.0:1787848416.224119:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93ff79442580 x1874694611446656/t0(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:122/0 lens 504/0 e 0 to 0 dl 1787848427 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787848416.224131:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff79442580 with x1874694611446656 ext(0->8) 00002000:00010000:3.0:1787848416.224137:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff79442580 00000100:00100000:3.0:1787848416.224163:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:3.0:1787848416.224172:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79442580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611446656:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787848416.235288:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79442580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611446656:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 Request processed in 11102us (18588us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787848416.235306:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00002000:00100000:2.0:1787848416.235320:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93ff79442580 x1874694611446656/t4294967302(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:122/0 lens 504/448 e 0 to 0 dl 1787848427 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787848416.235331:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff79442580 with x1874694611446656 ext(0->8) 00002000:00010000:2.0:1787848416.235337:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff79442580 00000100:00100000:1.0:1787848416.245312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848416.258780:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611446784 00000100:00100000:2.0:1787848416.258813:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611446784 00000100:00100000:2.0:1787848416.258909:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:2.0:1787848416.258920:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10464:x1874694611446784:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1787848416.305961:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787848416.438514:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:0.0:1787848416.438531:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1787848416.438539:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1787848416.438867:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10464:x1874694611446784:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 Request processed in 179943us (193560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848416.438879:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 80 00000004:00080000:0.0:1787848416.439271:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787848416.439300:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787848416.439310:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787848416.440087:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff794403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631398528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787848416.440150:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848416.440224:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631398528 00000100:00100000:2.0:1787848416.440230:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631398528 00000100:00100000:2.0:1787848416.440294:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787848416.440303:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631398528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787848416.440472:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787848416.440476:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787848416 00002000:00010000:2.0:1787848416.440479:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787848416.440482:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787848416 -> 1787848416 00002000:00010000:2.0:1787848416.440484:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787848416.440520:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631398528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (370us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787848416.440528:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787848416.441691:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787848416.441741:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff794403c0/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787848416.441749:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff794403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631398528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787848416.448966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848416.449673:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611446912 00000100:00100000:0.0:1787848416.449687:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611446912 00000100:00100000:0.0:1787848416.449744:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:0.0:1787848416.449754:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2351:x1874694611446912:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 00000040:00080000:2.0:1787848416.466918:0:12018:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787848416.466928:0:12018:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787848416.466971:0:12018:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787848416.466977:0:12018:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787848416.494936:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2351:x1874694611446912:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 Request processed in 45171us (45968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848416.494953:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 30 00000001:00080000:0.0:1787848416.494987:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787848416.494998:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1787848416.498403:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848416.498926:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611447168 00000100:00100000:3.0:1787848416.498938:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611447168 00000100:00100000:3.0:1787848416.499003:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 81 00000100:00100000:3.0:1787848416.499012:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10464:x1874694611447168:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787848416.499067:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848416.499096:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbaa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2d6 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.499114:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff48373800) 00010000:00010000:3.0:1787848416.499119:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848416.499155:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cbabb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.499170:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cbabb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.499181:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cbabb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787848416.499478:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021feeec1 reply state 00000000a702e657 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cbabb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848416.499489:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787848416.500094:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10464:x1874694611447168:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 1080us (1700us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787848416.500102:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 81 00000100:00100000:1.0:1787848416.516171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:2.0:1787848416.516354:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cbabb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.516387:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cbabb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.516395:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cbabb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.516402:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236e00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848416.516408:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cbabb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.516417:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cbabb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.516434:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff48373800) 00010000:00010000:2.0:1787848416.516437:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848416.516443:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cbabb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.516450:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cbabb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848416.518314:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611447296 00000100:00100000:3.0:1787848416.518328:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611447296 00000100:00100000:3.0:1787848416.518407:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:3.0:1787848416.518416:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611447296:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787848416.518840:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787848416.518844:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787848416 -> 1787848415 00002000:00010000:3.0:1787848416.518847:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787848413 00002000:00010000:3.0:1787848416.518849:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787848416 -> 1787848415 00002000:00010000:3.0:1787848416.518852:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787848416.518947:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611447296:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 532us (2786us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787848416.518956:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:0.0:1787848416.540537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848416.546015:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611447552 00000100:00100000:3.0:1787848416.546039:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611447552 00000100:00100000:1.0:1787848416.547866:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:1.0:1787848416.547880:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10464:x1874694611447552:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787848416.547964:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848416.547984:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cba83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c8 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848416.547995:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848416.548028:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cba83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c8 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848416.548043:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cba83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c8 expref: 13 pid: 5844 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848416.548058:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79441a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631398656:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787848416.548158:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848416.559325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848416.559391:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611447680 00000100:00100000:0.0:1787848416.559411:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611447680 00010000:00010000:0.0:1787848416.559461:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cba83 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c8 expref: 14 pid: 5844 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848416.559510:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:0.0:1787848416.559522:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:2352:x1874694611447680:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848416.559538:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848416.559545:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cba83 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c8 expref: 14 pid: 5844 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.559576:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cba83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c8 expref: 14 pid: 5844 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.559600:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff48373800) 00010000:00010000:0.0:1787848416.559605:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.559616:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.559624:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.559665:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848416.559717:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:2352:x1874694611447680:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 198us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848416.559725:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 43 00010000:00010000:3.0:1787848416.563032:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cba83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2c8 expref: 13 pid: 5844 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848416.563060:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79441a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631398656:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848416.563086:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.563194:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.563202:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.563232:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.563239:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.563245:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.563251:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42fa00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848416.563263:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.563271:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.563287:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff48373800) 00010000:00010000:0.0:1787848416.563291:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787848416.563295:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.563303:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbac2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848416.563411:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:10464:x1874694611447552:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 Request processed in 15525us (22876us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787848416.563439:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:1.0:1787848416.570236:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848416.570333:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611447808 00000100:00100000:3.0:1787848416.570344:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611447808 00000100:00100000:3.0:1787848416.570409:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:3.0:1787848416.570419:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611447808:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787848416.570476:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.570501:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.570512:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848416.570517:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787848416.570522:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.570575:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.570589:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 7 pid: 6689 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848416.570621:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874694631398784:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848416.570744:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6edec0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848416.573332:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874694631398784:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848416.573369:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848416.577767:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848416.577862:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611447936 00000100:00100000:3.0:1787848416.577873:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611447936 00010000:00010000:3.0:1787848416.577919:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 8 pid: 6689 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848416.577964:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:3.0:1787848416.577976:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80748780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2351:x1874694611447936:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848416.577993:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848416.578020:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 8 pid: 6689 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.578036:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 8 pid: 6689 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.578063:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb59c70c/0x9aeb41e0543cbab4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2e4 expref: 8 pid: 6689 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.578084:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787848416.578099:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787848416.578107:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.578118:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.578154:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848416.578207:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80748780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611447936:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 234us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848416.578216:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00010000:00010000:0.0:1787848416.578324:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.578334:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.578364:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.578374:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.578383:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.578390:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237800 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848416.578396:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.578406:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.578419:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.578438:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cbac9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848416.578489:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611447808:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 Request processed in 8070us (8263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848416.578498:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:3.0:1787848416.590534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848416.590625:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611448192 00000100:00100000:2.0:1787848416.590635:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611448192 00000100:00100000:2.0:1787848416.590721:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 83 00000100:00100000:2.0:1787848416.590731:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:10464:x1874694611448192:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787848416.590812:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbad0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.590831:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.590857:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.591102:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.591112:0:7097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2cf expref: 13 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.591121:0:7097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.591153:0:7097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2cf expref: 13 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.591167:0:7097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2cf expref: 13 pid: 9224 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848416.591181:0:7097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7097:1874694631398912:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848416.591277:0:7097:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff44eec480 going to sleep for 11 seconds 00000100:00100000:1.0:1787848416.603162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848416.603747:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611448320 00000100:00100000:1.0:1787848416.603756:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611448320 00010000:00010000:1.0:1787848416.603807:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba91 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2cf expref: 14 pid: 9224 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848416.603849:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:1.0:1787848416.603859:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:2352:x1874694611448320:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848416.603873:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848416.603880:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba91 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2cf expref: 14 pid: 9224 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848416.603895:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2cf expref: 14 pid: 9224 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848416.603940:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff48373800) 00010000:00010000:1.0:1787848416.603946:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848416.603956:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848416.603964:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848416.603982:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848416.604034:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:2352:x1874694611448320:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 176us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848416.604042:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 45 00010000:00010000:0.0:1787848416.604398:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cba91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2cf expref: 13 pid: 9224 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848416.604415:0:7097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7097:1874694631398912:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848416.604436:0:7097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.604445:0:7097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848416.604451:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787848416.605862:0:7097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787848416.606046:0:7097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787848416.606093:0:7097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787848416.606186:0:7097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7097:1874694631399040:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787848416.606270:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848416.609349:0:7097:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6a3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787848416.610968:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631399040 00000100:00100000:2.0:1787848416.610980:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631399040 00000100:00100000:2.0:1787848416.611160:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787848416.611171:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7097:x1874694631399040:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787848416.611320:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7097:x1874694631399040:12345-0@lo:1000:mdt00_003.0 Request processed in 151us (5050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848416.611329:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787848416.611408:0:7097:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787848416.611414:0:7097:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff794403c0, transno 4294967303 00000100:00100000:3.0:1787848416.611432:0:7097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7097:1874694631399040:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787848416.611968:0:7097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787848416.612052:0:7097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7097:1874694631399168:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787848416.612092:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848416.612888:0:7097:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff813aca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787848416.612930:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631399168 00000100:00100000:0.0:1787848416.612936:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631399168 00000100:00100000:0.0:1787848416.612973:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787848416.612981:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7097:x1874694631399168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787848416.613165:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7097:x1874694631399168:12345-0@lo:1000:mdt00_003.0 Request processed in 185us (1071us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787848416.613172:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848416.613754:0:7097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7097:1874694631399168:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787848416.613796:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613805:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613812:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613828:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848416.613833:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613841:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613857:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff48373800) 00010000:00010000:3.0:1787848416.613860:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787848416.613865:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613871:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbad7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613908:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cba05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613915:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cba05 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613921:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cba05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613925:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848416.613927:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cba05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613931:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cba05 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613949:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff48373600) 00010000:00010000:3.0:1787848416.613951:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787848416.613954:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cba05 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613959:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cba05 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613979:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.613992:0:7097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2b3 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.614001:0:7097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.614025:0:7097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2b3 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.614039:0:7097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2b3 expref: 16 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848416.614052:0:7097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff794403c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7097:1874694631399296:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848416.614128:0:7097:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fbe1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787848416.618191:0:7097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff794403c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7097:1874694631399296:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848416.618223:0:7097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848416.623104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848416.623171:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611448448 00000100:00100000:3.0:1787848416.623180:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611448448 00010000:00010000:3.0:1787848416.623226:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2b3 expref: 17 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848416.623279:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:3.0:1787848416.623290:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:2351:x1874694611448448:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848416.623306:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848416.623313:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2b3 expref: 17 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.623327:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2b3 expref: 17 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.623351:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cba28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2b3 expref: 17 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.623369:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff48373600) 00010000:00010000:3.0:1787848416.623373:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.623383:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.623392:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848416.623432:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848416.623508:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:2351:x1874694611448448:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 219us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848416.623517:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 46 00010000:00010000:2.0:1787848416.623818:0:7097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623827:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623838:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623845:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623851:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623858:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848416.623862:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623869:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623879:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff48373600) 00010000:00010000:2.0:1787848416.623882:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848416.623885:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623891:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cbade lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623904:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623910:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbad0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623923:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623928:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848416.623931:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623936:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbad0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623944:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff48373600) 00010000:00010000:2.0:1787848416.623946:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787848416.623949:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbad0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.623954:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbad0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848416.624157:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:10464:x1874694611448192:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 33426us (33632us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787848416.624166:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 83 00000020:00080000:2.0:1787848416.624174:0:7097:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787848416.624330:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787848416.624335:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787848416.624370:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787848416.624376:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787848416.634681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848416.634762:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611448704 00000100:00100000:2.0:1787848416.634771:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611448704 00000100:00100000:2.0:1787848416.634840:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:2.0:1787848416.634850:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:10464:x1874694611448704:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787848416.635543:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787848416.635679:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787848416.635729:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbae5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.635746:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.635757:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.635764:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbae5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.635771:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbae5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.635777:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.635797:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787848416.635884:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:10464:x1874694611448704:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 1035us (1246us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787848416.635891:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000020:00080000:2.0:1787848416.635897:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787848416.635920:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848416.635925:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbae5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.635933:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848416.635936:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbae5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.635944:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.635962:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:2.0:1787848416.635965:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787848416.635970:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbae5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.635977:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbae5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848416.635993:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848416.635995:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848416.635996:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848417.327787:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787848418.222979:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:2.0:1787848418.351939:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787848418.635938:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787848418.635948:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787848418.635988:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787848418.635994:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787848418.673273:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631399552:0@lo:400:kworker.0 00000100:00100000:3.0:1787848418.673313:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631399808:0@lo:400:kworker.0 00000100:00100000:1.0:1787848418.673364:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848418.673365:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848418.673440:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787848418.673447:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631399424:0@lo:400:kworker.0 00000100:00100000:0.0:1787848418.673544:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631399680:0@lo:400:kworker.0 00000100:00100000:1.0:1787848418.679427:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff52190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631400064:0@lo:400:kworker.0 00000100:00100000:1.0:1787848418.679509:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848418.679590:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631399552 00000100:00100000:1.0:1787848418.679599:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631399552 00000100:00100000:1.0:1787848418.679667:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787848418.679678:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631399552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848418.679736:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631399552:12345-0@lo:400:kworker.0 Request processed in 60us (6375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848418.679743:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787848418.679764:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631399808 00000100:00100000:1.0:1787848418.679768:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631399808 00000100:00100000:1.0:1787848418.679802:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631400064 00000100:00100000:1.0:1787848418.679804:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631400064 00000100:00100000:1.0:1787848418.679826:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787848418.679832:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631399808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848418.679864:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631399808:12345-0@lo:400:kworker.0 Request processed in 33us (6502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848418.679870:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787848418.679882:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787848418.679887:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874694631400064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848418.679926:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874694631400064:12345-0@lo:400:kworker.0 Request processed in 39us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848418.679931:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787848418.679949:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848418.679953:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787848418.679985:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631399552:0@lo:400:kworker.0 00000100:00100000:1.0:1787848418.679996:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff52190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631400064:0@lo:400:kworker.0 00000100:00100000:3.0:1787848418.681051:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848418.681094:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff521903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631399936:0@lo:400:kworker.0 00000100:00100000:3.0:1787848418.681130:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848418.681167:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787848418.681174:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1787848418.681193:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff79443c00, transno 4294967301 00000100:00100000:3.0:1787848418.681204:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631399808:0@lo:400:kworker.0 00000100:00100000:1.0:1787848418.681361:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631399424 00000100:00100000:1.0:1787848418.681368:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631399424 00000100:00100000:1.0:1787848418.681407:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787848418.681414:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631399424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848418.681458:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631399424:12345-0@lo:400:kworker.0 Request processed in 44us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848418.681464:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787848418.681903:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848418.681939:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631399936 00000100:00100000:0.0:1787848418.681942:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631399936 00000100:00100000:0.0:1787848418.681974:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631399680 00000100:00100000:0.0:1787848418.681977:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631399680 00000100:00100000:0.0:1787848418.681999:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787848418.682006:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631399936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848418.682040:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631399936:12345-0@lo:400:kworker.0 Request processed in 36us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848418.682046:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787848418.682057:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787848418.682063:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631399680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848418.682093:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631399680:12345-0@lo:400:kworker.0 Request processed in 30us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848418.682099:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787848418.682126:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631399680:0@lo:400:kworker.0 00000100:00080000:0.0:1787848418.682158:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848418.682174:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631399424:0@lo:400:kworker.0 00000100:00100000:0.0:1787848418.686616:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff521903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631399936:0@lo:400:kworker.0 00000100:00100000:3.0:1787848418.828986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848418.829042:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611448960 00000100:00100000:3.0:1787848418.829052:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611448960 00000100:00100000:3.0:1787848418.829117:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 84 00000100:00100000:3.0:1787848418.829127:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:10483:x1874694611448960:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848418.829152:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848418.829169:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbaec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2eb expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848418.829389:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cbaf3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848418.829410:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cbaf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848418.829422:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cbaf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848418.829434:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787848418.829591:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbaec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2eb expref: 20 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848418.829606:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cbaf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2eb expref: 19 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848418.829614:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:3.0:1787848418.829616:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787848418.829619:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236400, rc 0) 00000100:00100000:3.0:1787848418.829697:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10483:x1874694611448960:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 572us (720us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787848418.829702:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 84 00000100:00080000:3.0:1787848418.829720:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848418.838188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848418.838259:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611449088 00000100:00100000:0.0:1787848418.838271:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611449088 00000100:00100000:0.0:1787848418.838335:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 85 00000100:00100000:0.0:1787848418.838346:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10483:x1874694611449088:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:0.0:1787848418.838441:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838460:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838473:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838486:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838493:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838498:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838809:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838815:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838820:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787848418.838864:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838879:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838886:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838893:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838899:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148da00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848418.838903:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838910:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838921:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848418.838923:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848418.838926:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838930:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838939:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838943:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838951:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838954:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148d400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848418.838956:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838959:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838963:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff48373700) 00010000:00010000:0.0:1787848418.838964:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848418.838966:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838970:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838984:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838989:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.838995:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.839000:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148ca00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848418.839003:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.839026:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.839032:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848418.839033:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848418.839035:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.839039:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848418.839105:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10483:x1874694611449088:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 762us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848418.839110:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 85 00000100:00100000:3.0:1787848418.911794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848418.911886:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611449344 00000100:00100000:1.0:1787848418.911896:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611449344 00000100:00100000:1.0:1787848418.911955:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:1.0:1787848418.911966:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10486:x1874694611449344:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848418.911988:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848418.912019:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2f2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912094:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912108:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912132:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912148:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbb24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912155:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbb24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912162:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbb24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912524:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbb2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912545:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbb2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912552:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbb2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848418.912562:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787848418.912691:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912699:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912705:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912711:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ec00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848418.912721:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912728:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912739:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:1.0:1787848418.912742:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848418.912747:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912754:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912767:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbb24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912772:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbb24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912778:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbb24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912783:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42fe00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848418.912786:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbb24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912792:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbb24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912801:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff43951000) 00010000:00010000:1.0:1787848418.912803:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848418.912813:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbb24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912819:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbb24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912863:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f2 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912877:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbb2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f2 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.912883:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:1.0:1787848418.912886:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787848418.912888:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f600, rc 0) 00000100:00100000:1.0:1787848418.912966:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:10486:x1874694611449344:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1003us (1181us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787848418.912974:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:3.0:1787848418.936536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848418.936668:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611449472 00000100:00100000:1.0:1787848418.936678:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611449472 00000100:00100000:1.0:1787848418.936728:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00100000:1.0:1787848418.936738:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79648780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:10486:x1874694611449472:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:1.0:1787848418.936800:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.936815:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.936827:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.936863:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.936870:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.936877:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.936884:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848418.936889:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.936896:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.936907:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:1.0:1787848418.936910:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787848418.936915:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848418.936922:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848418.936984:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79648780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:10486:x1874694611449472:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 247us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848418.936992:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00100000:3.0:1787848418.941765:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848418.941865:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611449728 00000100:00100000:1.0:1787848418.941877:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611449728 00000100:00100000:1.0:1787848418.941928:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:1.0:1787848418.941954:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff47b4c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:10486:x1874694611449728:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848418.942209:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff47b4c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:10486:x1874694611449728:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 257us (452us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787848418.942226:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:3.0:1787848418.997426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848418.997539:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611449984 00000100:00100000:0.0:1787848418.997549:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611449984 00000100:00100000:0.0:1787848418.997610:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 88 00000100:00100000:0.0:1787848418.997621:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:10005:x1874694611449984:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787848418.997685:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848418.997708:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb40 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb2f9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.997813:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.997827:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbb2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f2 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.997836:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.997882:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbb2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f2 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848418.997897:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbb2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f2 expref: 23 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848418.997910:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874694631400192:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848418.998008:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6a3480 going to sleep for 11 seconds 00000100:00100000:3.0:1787848419.002170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.002274:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611450112 00000100:00100000:1.0:1787848419.002283:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611450112 00010000:00010000:1.0:1787848419.002334:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbb2b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f2 expref: 24 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848419.002381:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:1.0:1787848419.002392:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:2352:x1874694611450112:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848419.002419:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848419.002428:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbb2b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f2 expref: 24 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.002441:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbb2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f2 expref: 24 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.002465:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:1.0:1787848419.002471:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.002480:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.002488:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.002541:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848419.002594:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:2352:x1874694611450112:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 203us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848419.002602:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00010000:00010000:0.0:1787848419.003328:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbb2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f2 expref: 23 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848419.003346:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874694631400192:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848419.003367:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.003376:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.003382:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848419.003410:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787848419.003582:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb40 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f9 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.003598:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f9 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.003621:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:0.0:1787848419.003624:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787848419.003627:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148d400, rc 0) 00000100:00100000:0.0:1787848419.003728:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:10005:x1874694611449984:12345-192.168.201.26@tcp:101:bash.0 Request processed in 6108us (6326us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787848419.003735:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 88 00000100:00100000:3.0:1787848419.009152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.009255:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611450368 00000100:00100000:1.0:1787848419.009264:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611450368 00000100:00100000:1.0:1787848419.009322:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 89 00000100:00100000:1.0:1787848419.009332:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff796483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:10005:x1874694611450368:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:1.0:1787848419.009617:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.009632:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.009929:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787848419.009987:0:9224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787848419.010012:0:9224:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005635e74c reply state 00000000a5cdbe53 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848419.010021:0:9224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787848419.010069:0:9224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787848419.010186:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff796483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:10005:x1874694611450368:12345-192.168.201.26@tcp:36:bash.0 Request processed in 853us (1040us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787848419.010193:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 89 00000020:00080000:1.0:1787848419.010198:0:9224:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787848419.012427:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.012442:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.012450:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.012455:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848419.012459:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.012466:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.012482:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:0.0:1787848419.012485:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848419.012490:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.012496:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbb55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848419.014432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848419.014580:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611450496 00000100:00100000:2.0:1787848419.014591:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611450496 00000100:00100000:2.0:1787848419.014686:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 90 00000100:00100000:2.0:1787848419.014698:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:10005:x1874694611450496:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787848419.014722:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848419.014742:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbb5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb300 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.014798:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbb5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb300 expref: 27 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.014816:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbb5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb300 expref: 27 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.014833:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:2.0:1787848419.014848:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787848419.014852:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665800, rc 0) 00000100:00100000:2.0:1787848419.014909:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:10005:x1874694611450496:12345-192.168.201.26@tcp:101:bash.0 Request processed in 214us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848419.014917:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 90 00000100:00100000:3.0:1787848419.018692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.018828:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611450624 00000100:00100000:1.0:1787848419.018838:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611450624 00000100:00100000:1.0:1787848419.018919:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:1.0:1787848419.018931:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:10005:x1874694611450624:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787848419.018950:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848419.018970:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cbb63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb307 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787848419.018997:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9066df, atime: 0x6a9066dd, ctime: 0x6a9066df, blocks: 0xb 00010000:00010000:1.0:1787848419.019017:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1787848419.019022:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848419.019030:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cbb63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb307 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.019048:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cbb63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb307 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.019059:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42fe00, rc 0) 00000100:00100000:1.0:1787848419.019124:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:10005:x1874694611450624:12345-192.168.201.26@tcp:101:bash.0 Request processed in 195us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848419.019132:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00080000:3.0:1787848419.019517:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787848419.021918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848419.022017:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611450752 00000100:00100000:0.0:1787848419.022026:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611450752 00002000:00010000:0.0:1787848419.022069:0:6695:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787848419.022074:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff79648000 with x1874694611450752 ext(0->18446744073709551615) 00002000:00010000:0.0:1787848419.022085:0:6695:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff79648000. 00000100:00100000:0.0:1787848419.022120:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:0.0:1787848419.022130:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2354:x1874694611450752:12345-192.168.201.26@tcp:10:bash.0 00002000:00010000:0.0:1787848419.022412:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787848419.022416:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787848415 -> 1787848419 00002000:00010000:0.0:1787848419.022418:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787848413 -> 1787848413 00002000:00010000:0.0:1787848419.022421:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787848415 -> 1787848419 00002000:00010000:0.0:1787848419.022423:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787848419.022492:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2354:x1874694611450752:12345-192.168.201.26@tcp:10:bash.0 Request processed in 362us (582us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787848419.022500:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00002000:00010000:0.0:1787848419.022504:0:6695:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787848419.022507:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff79648000 with x1874694611450752 ext(0->18446744073709551615) 00002000:00010000:0.0:1787848419.022511:0:6695:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff79648000. 00000100:00100000:2.0:1787848419.112173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848419.112312:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611450880 00000100:00100000:0.0:1787848419.112322:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611450880 00000100:00100000:0.0:1787848419.112380:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:0.0:1787848419.112390:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:10500:x1874694611450880:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:0.0:1787848419.112474:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.112509:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.112523:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.112721:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.112729:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.112736:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113017:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbb78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113027:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113035:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787848419.113071:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113083:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113089:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113104:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113110:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148ca00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848419.113114:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113122:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113135:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848419.113138:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848419.113143:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113150:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbb6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113162:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113168:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113174:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113179:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148da00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848419.113182:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113196:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113204:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff48373200) 00010000:00010000:0.0:1787848419.113206:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848419.113209:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113225:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbb71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113241:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113247:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbb78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113253:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbb78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113258:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848419.113262:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbb78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113267:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbb78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113274:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:0.0:1787848419.113276:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848419.113279:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbb78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.113293:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbb78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848419.113479:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:10500:x1874694611450880:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 1088us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848419.113488:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:3.0:1787848419.174749:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.175154:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611451136 00000100:00100000:1.0:1787848419.175165:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611451136 00000100:00100000:1.0:1787848419.175228:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00100000:1.0:1787848419.175239:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:10503:x1874694611451136:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848419.175260:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848419.175280:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb30e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175366:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbb86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175380:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbb86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175392:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbb86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175405:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbb8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175412:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbb8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175418:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbb8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175763:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbb94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175772:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbb94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175780:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbb94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848419.175789:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787848419.175871:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbb86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175878:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbb86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175890:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbb86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175896:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848419.175900:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbb86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175907:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbb86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175920:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:1.0:1787848419.175924:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848419.175928:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbb86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175934:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbb86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175947:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbb8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175952:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbb8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175958:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbb8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175962:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848419.175966:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbb8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175982:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbb8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.175989:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff43951800) 00010000:00010000:1.0:1787848419.175992:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848419.175994:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbb8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.176000:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbb8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.176040:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbb7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb30e expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.176055:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbb94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb30e expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.176063:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:1.0:1787848419.176065:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787848419.176067:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f800, rc 0) 00000100:00100000:1.0:1787848419.176136:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:10503:x1874694611451136:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 898us (1396us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787848419.176144:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00100000:3.0:1787848419.179377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.179455:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611451264 00000100:00100000:1.0:1787848419.179464:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611451264 00000100:00100000:1.0:1787848419.179530:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 93 00000100:00100000:1.0:1787848419.179541:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:10503:x1874694611451264:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:1.0:1787848419.179621:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.179674:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f9 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.179685:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.179883:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f9 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.179897:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f9 expref: 29 pid: 5844 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848419.179912:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791c3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631400320:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848419.180386:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848419.183056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848419.183131:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791c3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631400320:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848419.183160:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848419.183203:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611451520 00000100:00100000:1.0:1787848419.183220:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611451520 00000100:00100000:1.0:1787848419.183282:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:1.0:1787848419.183292:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:5593:x1874694611451520:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787848419.183765:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787848419.183768:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631400448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848419.183779:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631400576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848419.187999:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848419.188331:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+31:5593:x1874694611451520:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 5033us (5275us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787848419.188346:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:3.0:1787848419.188823:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848419.191087:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631400448 00000100:00100000:2.0:1787848419.191104:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631400448 00000100:00100000:2.0:1787848419.191180:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631400576 00000100:00100000:2.0:1787848419.191183:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631400576 00000100:00100000:2.0:1787848419.191204:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787848419.191224:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631400448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848419.191273:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848419.191361:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631400448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848419.191369:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787848419.191402:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787848419.191411:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631400576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848419.191441:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848419.191478:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631400576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (2656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848419.191484:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787848419.191536:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631400576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848419.191928:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631400448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848419.192594:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848419.192745:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611451648 00000100:00100000:2.0:1787848419.192752:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611451648 00010000:00010000:2.0:1787848419.192782:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f9 expref: 31 pid: 5844 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848419.192814:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:2.0:1787848419.192822:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+31:2351:x1874694611451648:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848419.192833:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848419.192839:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f9 expref: 31 pid: 5844 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.192853:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f9 expref: 31 pid: 5844 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.192875:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbb47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2f9 expref: 31 pid: 5844 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.192891:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:2.0:1787848419.192897:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.192916:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.192923:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.192953:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848419.192998:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:2351:x1874694611451648:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 176us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848419.193569:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00010000:00010000:0.0:1787848419.194288:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.194298:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.194331:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.194338:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.194344:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.194349:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42fc00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848419.194353:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.194372:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.194386:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:0.0:1787848419.194388:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787848419.194393:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.194399:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848419.194492:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:10503:x1874694611451264:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 14952us (15123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848419.194500:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 93 00000100:00100000:2.0:1787848419.199897:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848419.199998:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611451904 00000100:00100000:3.0:1787848419.200078:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611451904 00000100:00100000:3.0:1787848419.200197:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:3.0:1787848419.200218:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:10503:x1874694611451904:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:3.0:1787848419.200530:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:10503:x1874694611451904:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 324us (644us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787848419.200538:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 23 00010000:00010000:0.0:1787848419.375828:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848419.379456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848419.379684:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611452160 00000100:00100000:0.0:1787848419.379694:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611452160 00000100:00100000:0.0:1787848419.379753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:0.0:1787848419.379762:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:10514:x1874694611452160:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:0.0:1787848419.379785:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848419.379805:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbba9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb315 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.379873:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.379888:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.379917:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.379934:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.379941:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.379948:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380263:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbbbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380274:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbbbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380280:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbbbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848419.380290:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1787848419.380373:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380381:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380387:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380393:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148da00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848419.380403:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380411:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380423:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848419.380426:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848419.380430:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380437:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380451:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380457:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380462:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380467:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148ca00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848419.380471:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380476:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380483:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff48373200) 00010000:00010000:0.0:1787848419.380485:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848419.380494:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380863:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380914:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbba9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb315 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380927:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbbbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb315 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.380933:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:0.0:1787848419.380935:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848419.380938:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c800, rc 0) 00000100:00100000:0.0:1787848419.381013:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:10514:x1874694611452160:12345-192.168.201.26@tcp:101:cat.0 Request processed in 1252us (1567us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787848419.381021:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:2.0:1787848419.407813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.407906:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611452416 00000100:00100000:1.0:1787848419.407915:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611452416 00000100:00100000:1.0:1787848419.407974:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:1.0:1787848419.407984:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:10514:x1874694611452416:12345-192.168.201.26@tcp:35:cat.0 00000100:00100000:1.0:1787848419.408273:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+33:10514:x1874694611452416:12345-192.168.201.26@tcp:35:cat.0 Request processed in 289us (784us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787848419.408282:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:2.0:1787848419.444375:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.444456:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611452672 00000100:00100000:1.0:1787848419.444465:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611452672 00000100:00100000:1.0:1787848419.444546:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 95 00000100:00100000:1.0:1787848419.444557:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+33:10515:x1874694611452672:12345-192.168.201.26@tcp:36:rm.0 00010000:00010000:1.0:1787848419.444665:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787848419.444697:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbbbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb315 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.444719:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbb94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb30e expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.444733:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbb5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb300 expref: 31 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.444743:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951300) 00010000:00010000:1.0:1787848419.444753:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787848419.444774:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbbcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.444787:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbbcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.444798:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbbcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.444811:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbbd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.444818:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.444824:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.445355:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbbda lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.445365:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbbda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.445372:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbbda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787848419.446334:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1787848419.446344:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368357703837ns, next at 369357701332ns, rc = 0 00010000:00010000:1.0:1787848419.446403:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbbe1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.446414:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbbe1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.446423:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbbe1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.446430:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbbe1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.446436:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbbe1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.446442:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbbe1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.446468:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787848419.446491:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbbda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.446505:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbbda lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.446511:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbbda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.446697:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848419.446705:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbbe1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.446712:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848419.446716:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbbe1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.446724:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbbe1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.446736:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951100) 00010000:00010000:2.0:1787848419.446739:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787848419.446743:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbbe1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.446760:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbbe1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.446775:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848419.446777:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848419.446779:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848419.447261:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848419.447266:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbbda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.447273:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbbda lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.447282:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848419.447285:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787848419.447288:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbbda lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.447293:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbbda lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.447314:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbbcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.447321:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbbcc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.447327:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbbcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.447332:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ec00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848419.447342:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbbcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.447349:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbbcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.447357:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:1.0:1787848419.447359:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848419.447362:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbbcc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.447368:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbbcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787848419.447377:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005dbd3b2a reply state 00000000120749a8 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848419.447386:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787848419.447740:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:10515:x1874694611452672:12345-192.168.201.26@tcp:36:rm.0 Request processed in 3178us (3370us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787848419.447752:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 95 00010000:00010000:3.0:1787848419.461682:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.461702:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbbd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.461710:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbbd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.461717:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848419.461722:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbbd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.461729:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbbd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.461766:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff43951800) 00010000:00010000:3.0:1787848419.461769:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848419.461775:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbbd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.461782:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbbd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848419.536248:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848419.536460:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611452928 00000100:00100000:0.0:1787848419.536473:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611452928 00000100:00100000:0.0:1787848419.536547:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:0.0:1787848419.536559:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+31:10521:x1874694611452928:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787848419.536587:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848419.536609:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbbe8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb31c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.536774:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.536810:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.536821:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.536849:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.536858:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.536865:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787848419.537447:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787848419.538246:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbbfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.538259:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbbfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.538268:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbbfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.538302:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.538308:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.538314:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.538327:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148ca00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848419.538331:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.538338:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.538349:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848419.538352:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848419.538356:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.538362:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbbef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787848419.538376:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c155bd1 reply state 00000000b18131a1 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848419.538385:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787848419.538416:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbbe8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb31c expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.538430:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbbfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb31c expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.538438:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848419.538440:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848419.538442:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c600, rc 0) 00000100:00100000:0.0:1787848419.539109:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:10521:x1874694611452928:12345-192.168.201.26@tcp:101:bash.0 Request processed in 2549us (2871us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787848419.539126:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 96 00010000:00010000:3.0:1787848419.557729:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.557750:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.557759:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.557765:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148da00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848419.557770:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.557778:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.557806:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff48373200) 00010000:00010000:3.0:1787848419.557810:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848419.557814:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.557820:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbbf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848419.559273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.559535:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611453056 00000100:00100000:1.0:1787848419.559546:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611453056 00000100:00100000:1.0:1787848419.559630:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:1.0:1787848419.559673:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2351:x1874694611453056:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787848419.559695:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848419.559716:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbc0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb323 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787848419.559745:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848419.559778:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1787848419.559783:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848419.559793:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbc0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb323 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.559812:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbc0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb323 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.559826:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42ec00, rc 0) 00000100:00080000:3.0:1787848419.559961:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787848419.560141:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611453056:12345-192.168.201.26@tcp:101:bash.0 Request processed in 501us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848419.560149:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:2.0:1787848419.565336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.565428:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611453184 00000100:00100000:1.0:1787848419.565439:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611453184 00000100:00100000:1.0:1787848419.565506:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:1.0:1787848419.565530:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:10521:x1874694611453184:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787848419.565549:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848419.565567:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb32a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.565605:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbc0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb323 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.565616:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848419.565621:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848419.565626:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.565721:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbc0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb323 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.565735:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbc0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb323 expref: 7 pid: 6689 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848419.565749:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791c21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1874694631400704:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787848419.566279:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6913c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848419.569803:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791c21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1874694631400704:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787848419.570007:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.570032:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e200, rc 0) 00000100:00100000:1.0:1787848419.570103:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:10521:x1874694611453184:12345-192.168.201.26@tcp:101:bash.0 Request processed in 4575us (4778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848419.570114:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:2.0:1787848419.570987:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.571260:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611453312 00000100:00100000:1.0:1787848419.571269:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611453312 00010000:00010000:1.0:1787848419.571306:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbc0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb323 expref: 7 pid: 6689 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848419.571335:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:1.0:1787848419.571345:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff50bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611453312:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848419.571376:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848419.571401:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbc0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb323 expref: 7 pid: 6689 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.571415:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbc0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb323 expref: 7 pid: 6689 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.571440:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c266a3e4/0x9aeb41e0543cbc0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb323 expref: 7 pid: 6689 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.571456:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848419.571460:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848419.571468:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.571479:0:8522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.571770:0:8522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848419.571931:0:8522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791c21c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8522:1874694631400832:192.168.201.26@tcp:105: 00000100:00100000:1.0:1787848419.572019:0:8522:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6913c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848419.575380:0:8522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791c21c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8522:1874694631400832:192.168.201.26@tcp:105: 00010000:00010000:1.0:1787848419.575408:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848419.575469:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff50bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611453312:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 4125us (4486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848419.575481:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:3.0:1787848419.577287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.577673:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611453568 00000100:00100000:1.0:1787848419.577683:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611453568 00000100:00100000:1.0:1787848419.577739:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:1.0:1787848419.577749:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+33:10521:x1874694611453568:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:1.0:1787848419.578125:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:10521:x1874694611453568:12345-192.168.201.26@tcp:35:bash.0 Request processed in 375us (845us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787848419.578132:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:2.0:1787848419.832301:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848419.832615:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611453696 00000100:00100000:0.0:1787848419.832625:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611453696 00000100:00100000:0.0:1787848419.833970:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00100000:0.0:1787848419.833995:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:10537:x1874694611453696:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848419.834020:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848419.834039:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbc19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb331 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.834105:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbc20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.834118:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbc20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.834128:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbc20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848419.834187:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787848419.834190:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848419.834222:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbc20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.834244:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbc19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb331 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.834262:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbc20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb331 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.834289:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848419.834292:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848419.834295:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148ca00, rc 0) 00000100:00100000:0.0:1787848419.834365:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:10537:x1874694611453696:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 385us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848419.834371:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00100000:2.0:1787848419.845266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.845375:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611453952 00000100:00100000:1.0:1787848419.845394:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611453952 00000100:00100000:1.0:1787848419.845495:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 98 00000100:00100000:1.0:1787848419.845508:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:10537:x1874694611453952:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848419.845538:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848419.845562:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb338 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.845733:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbc2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.845746:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbc2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.845756:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbc2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848419.845767:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787848419.845900:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb338 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.845934:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbc2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb338 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.845943:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373400) 00010000:00010000:1.0:1787848419.845946:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787848419.845949:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f800, rc 0) 00000100:00100000:1.0:1787848419.846023:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+37:10537:x1874694611453952:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 518us (765us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787848419.846030:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 98 00000100:00100000:2.0:1787848419.849532:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848419.849675:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611454080 00000100:00100000:0.0:1787848419.849685:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611454080 00000100:00100000:0.0:1787848419.849752:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:0.0:1787848419.849762:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+37:2354:x1874694611454080:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848419.849777:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848419.849802:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbc2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb338 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.849822:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848419.849827:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848419.849885:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+36:2354:x1874694611454080:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 125us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848419.849893:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:2.0:1787848419.853934:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848419.854009:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611454336 00000100:00100000:0.0:1787848419.854020:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611454336 00000100:00100000:0.0:1787848419.854082:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:0.0:1787848419.854091:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+36:10537:x1874694611454336:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848419.854115:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848419.854136:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbc3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb33f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.854260:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbc43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.854274:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbc43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.854283:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbc43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848419.854295:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787848419.854411:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbc3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb33f expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.854429:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbc43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb33f expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.854437:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848419.854440:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787848419.854444:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148da00, rc 0) 00000100:00100000:0.0:1787848419.854510:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:10537:x1874694611454336:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 419us (583us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787848419.854517:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:3.0:1787848419.871170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848419.871632:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611454464 00000100:00100000:2.0:1787848419.871682:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611454464 00000100:00100000:2.0:1787848419.871746:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:2.0:1787848419.871756:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611454464:12345-192.168.201.26@tcp:1:lfs.0 00010000:00010000:2.0:1787848419.871801:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.871819:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.871827:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848419.871831:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787848419.871836:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.871887:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.871899:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 6 pid: 6691 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848419.871913:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874694631400960:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848419.873307:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe41ac4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787848419.882217:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874694631400960:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848419.882253:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848419.884478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848419.884700:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611454592 00000100:00100000:2.0:1787848419.884710:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611454592 00002000:00100000:2.0:1787848419.884766:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93ff805c6580 x1874694611454592/t0(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:125/0 lens 504/0 e 0 to 0 dl 1787848430 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787848419.884777:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff805c6580 with x1874694611454592 ext(0->8) 00010000:00010000:2.0:1787848419.884785:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 7 pid: 6691 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.884799:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 7 pid: 6691 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787848419.884806:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ff805c6580 00000100:00100000:2.0:1787848419.884839:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:2.0:1787848419.884847:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2354:x1874694611454592:12345-192.168.201.26@tcp:4:lfs.0 00000100:00100000:2.0:1787848419.885364:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2354:x1874694611454592:12345-192.168.201.26@tcp:4:lfs.0 Request processed in 515us (891us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787848419.885494:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00002000:00100000:2.0:1787848419.885504:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93ff805c6580 x1874694611454592/t4294967302(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:125/0 lens 504/448 e 0 to 0 dl 1787848430 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787848419.885574:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff805c6580 with x1874694611454592 ext(0->8) 00010000:00010000:2.0:1787848419.885581:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 9 pid: 6691 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848419.885595:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 9 pid: 6691 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787848419.885601:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ff805c6580 00000100:00100000:2.0:1787848419.895163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848419.895260:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611454720 00000100:00100000:0.0:1787848419.895269:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611454720 00010000:00010000:0.0:1787848419.895313:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 9 pid: 6691 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848419.895363:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:0.0:1787848419.895403:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2353:x1874694611454720:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848419.895421:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787848419.895444:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787848419.895447:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787848420 00002000:00010000:0.0:1787848419.895449:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787848420 00002000:00010000:0.0:1787848419.895451:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787848420 00010000:00010000:0.0:1787848419.895457:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 9 pid: 6691 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.895470:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 9 pid: 6691 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.895495:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c78daced/0x9aeb41e0543cbc12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb32a expref: 9 pid: 6691 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.895520:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848419.895525:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848419.895532:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.895543:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.895783:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848419.895834:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2353:x1874694611454720:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 433us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848419.895841:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 50 00010000:00010000:3.0:1787848419.897135:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.897151:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.897189:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.897196:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.897216:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.897223:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848419.897228:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.897251:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.897269:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848419.897276:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034f21958/0x9aeb41e0543cbc51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848419.897372:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611454464:12345-192.168.201.26@tcp:1:lfs.0 Request processed in 25613us (26207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848419.897449:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:2.0:1787848419.903774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848419.903959:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611454976 00000100:00100000:1.0:1787848419.903970:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611454976 00000100:00100000:1.0:1787848419.904044:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:1.0:1787848419.904054:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff47b4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:10537:x1874694611454976:12345-192.168.201.26@tcp:35:lfs.0 00000004:00010000:1.0:1787848419.904119:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbc43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb33f expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787848419.904430:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787848419.904476:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787848419.904884:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787848419.904941:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.904956:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbbfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb31c expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.904965:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.905007:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbbfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb31c expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.905022:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbbfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb31c expref: 42 pid: 5842 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848419.905035:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791c21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1874694631401088:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787848419.905132:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f691b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787848419.915206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848419.916138:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611455104 00000100:00100000:1.0:1787848419.916145:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791c21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1874694631401088:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848419.916147:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611455104 00010000:00010000:1.0:1787848419.916171:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.916184:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbbfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb31c expref: 43 pid: 5842 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848419.916235:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:0.0:1787848419.916246:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+43:2351:x1874694611455104:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848419.916269:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848419.916277:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbbfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb31c expref: 43 pid: 5842 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.916290:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbbfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb31c expref: 43 pid: 5842 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.916314:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbbfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb31c expref: 43 pid: 5842 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.916332:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848419.916337:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.916346:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.916355:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.916381:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848419.916438:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+42:2351:x1874694611455104:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 193us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848419.916470:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 51 00010000:00010000:1.0:1787848419.917099:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.917108:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787848419.917253:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787848419.917479:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787848419.917710:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791c21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874694631401216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787848419.917776:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848419.917814:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431bdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848419.917998:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631401216 00000100:00100000:0.0:1787848419.918005:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631401216 00000100:00100000:0.0:1787848419.918060:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787848419.918070:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874694631401216:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787848419.918149:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874694631401216:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848419.918156:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787848419.919541:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791c21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874694631401216:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787848419.920876:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787848419.920966:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791c21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874694631401344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787848419.921753:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848419.921835:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f691b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787848419.926122:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631401344 00000100:00100000:0.0:1787848419.926138:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631401344 00000100:00100000:0.0:1787848419.926236:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787848419.926247:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874694631401344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787848419.927162:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1874694631401344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 914us (5406us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787848419.927171:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787848419.930265:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791c21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874694631401344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787848419.930386:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787848419.930456:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.930468:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.930475:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.930482:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ee00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848419.930487:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.931088:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.931107:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373400) 00010000:00010000:1.0:1787848419.931110:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787848419.931114:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848419.931120:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc58 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787848419.931357:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787848419.931450:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1787848419.931461:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368842820885ns, next at 369842818395ns, rc = 0 00000001:00080000:1.0:1787848419.931482:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787848419.932423:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373400) 00010000:00010000:1.0:1787848419.932429:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787848419.932438:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbc43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb33f expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848419.933157:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff47b4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+45:10537:x1874694611454976:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 29101us (29389us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787848419.933168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 26 00000020:00080000:1.0:1787848419.933174:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787848419.953416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848419.953523:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611455232 00000100:00100000:0.0:1787848419.953535:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611455232 00000100:00100000:0.0:1787848419.953597:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00100000:0.0:1787848419.953608:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+45:10537:x1874694611455232:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848419.953636:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848419.953700:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbc5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb346 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.953762:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbc5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb346 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.953787:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbc5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb346 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848419.953806:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:0.0:1787848419.953809:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787848419.953813:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c600, rc 0) 00000100:00100000:0.0:1787848419.953869:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+46:10537:x1874694611455232:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 262us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848419.953875:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00100000:2.0:1787848419.969527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848419.969727:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611455488 00000100:00100000:3.0:1787848419.969739:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611455488 00000100:00100000:3.0:1787848419.969798:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:3.0:1787848419.969806:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+46:10537:x1874694611455488:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:3.0:1787848419.970057:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+47:10537:x1874694611455488:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 251us (548us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787848419.970065:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:2.0:1787848420.207768:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848420.207860:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611455616 00000100:00100000:1.0:1787848420.207870:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611455616 00000100:00080000:3.0:1787848420.207919:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848420.208009:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 101 00000100:00100000:1.0:1787848420.208021:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79298b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+47:10547:x1874694611455616:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:1.0:1787848420.208099:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208117:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208131:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208147:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbc6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208154:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208160:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208318:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208327:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208334:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787848420.208382:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208396:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208416:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208423:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208429:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ee00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848420.208434:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208441:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208461:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:1.0:1787848420.208464:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848420.208469:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208481:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbc66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208508:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208514:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbc6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208519:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbc6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208524:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848420.208527:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbc6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208533:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbc6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208541:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff43951c00) 00010000:00010000:1.0:1787848420.208543:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848420.208546:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbc6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208551:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbc6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208564:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208569:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208579:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208584:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ec00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848420.208586:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208592:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208598:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:1.0:1787848420.208600:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848420.208603:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.208608:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbc74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848420.208735:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79298b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+47:10547:x1874694611455616:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 716us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848420.208744:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 101 00000100:00100000:2.0:1787848420.321820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848420.321917:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611455872 00000100:00100000:3.0:1787848420.321926:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611455872 00000100:00100000:3.0:1787848420.321990:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00100000:3.0:1787848420.322000:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+47:10550:x1874694611455872:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848420.322039:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848420.322060:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbc7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb34d expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.322134:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbc82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.322150:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbc82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.322163:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbc82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.322177:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbc89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.322184:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbc89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.322224:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbc89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.324665:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbc90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.324688:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbc90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.324700:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbc90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848420.324714:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787848420.324833:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbc82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.324841:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbc82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.324847:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbc82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.324854:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848420.324859:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbc82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.324867:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbc82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325040:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:3.0:1787848420.325043:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848420.325049:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbc82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325056:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbc82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325076:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbc89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325083:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbc89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325090:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbc89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325095:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848420.325105:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbc89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325112:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbc89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325121:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff541a1a00) 00010000:00010000:3.0:1787848420.325123:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848420.325126:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbc89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325132:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbc89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325184:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbc7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb34d expref: 50 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325208:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbc90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb34d expref: 49 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.325215:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:3.0:1787848420.325217:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848420.325219:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236600, rc 0) 00000100:00100000:3.0:1787848420.326215:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+49:10550:x1874694611455872:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 3636us (3824us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787848420.326229:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00100000:3.0:1787848420.330804:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848420.330978:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611456000 00000100:00100000:2.0:1787848420.330988:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611456000 00000100:00100000:2.0:1787848420.331052:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00100000:2.0:1787848420.331062:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+49:10550:x1874694611456000:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:2.0:1787848420.331132:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbc9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.331150:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbc9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.331175:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbc9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.331212:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbc9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.331220:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbc9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.331226:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbc9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.331232:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848420.331237:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbc9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.331245:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbc9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.331266:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:2.0:1787848420.331270:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787848420.331274:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbc9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.331281:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbc9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848420.331360:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+49:10550:x1874694611456000:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 299us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848420.331369:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00100000:2.0:1787848420.333836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848420.333975:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611456256 00000100:00100000:3.0:1787848420.333985:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611456256 00000100:00100000:3.0:1787848420.334044:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:3.0:1787848420.334061:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79299680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+49:10550:x1874694611456256:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:3.0:1787848420.334323:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79299680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+50:10550:x1874694611456256:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 264us (497us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787848420.334331:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 28 00010000:00010000:0.0:1787848420.399771:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848420.509086:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848420.509266:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611456512 00000100:00100000:0.0:1787848420.509277:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611456512 00000100:00100000:0.0:1787848420.509346:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00100000:0.0:1787848420.509357:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+50:10560:x1874694611456512:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787848420.509384:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848420.509387:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787848420.509428:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbc20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb331 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848420.509448:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848420.509453:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787848420.509466:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbca5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb354 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848420.509575:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbcac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848420.509606:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbcac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848420.509618:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbcac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848420.509631:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787848420.509812:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbca5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb354 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848420.509827:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbcac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb354 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848420.509836:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:0.0:1787848420.509839:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848420.509842:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c800, rc 0) 00000100:00100000:0.0:1787848420.509909:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+51:10560:x1874694611456512:12345-192.168.201.26@tcp:101:bash.0 Request processed in 554us (835us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787848420.509918:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00100000:2.0:1787848420.515311:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848420.515375:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611456768 00000100:00100000:3.0:1787848420.515390:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611456768 00000100:00100000:3.0:1787848420.515456:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 105 00000100:00100000:3.0:1787848420.515468:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+51:10560:x1874694611456768:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:3.0:1787848420.515529:0:9224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787848420.515560:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbcac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb354 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.515585:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbc90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb34d expref: 50 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.515596:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:3.0:1787848420.515601:0:9224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848420.515854:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.515868:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.515877:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787848420.515929:0:9224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787848420.515969:0:9224:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006e380af reply state 000000003e0411d2 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848420.515979:0:9224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787848420.518311:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+52:10560:x1874694611456768:12345-192.168.201.26@tcp:36:bash.0 Request processed in 2834us (2999us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787848420.518325:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 105 00000020:00080000:3.0:1787848420.518333:0:9224:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787848420.540207:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.540226:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.540234:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.540239:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848420.540244:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.540252:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.540270:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:3.0:1787848420.540274:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848420.540279:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.540287:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848420.541172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848420.541955:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611456896 00000100:00100000:2.0:1787848420.541967:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611456896 00000100:00100000:2.0:1787848420.542032:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 106 00000100:00100000:2.0:1787848420.542043:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8074b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+51:10560:x1874694611456896:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787848420.542069:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848420.542088:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbcc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb35b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.542168:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.542183:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.542207:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848420.542236:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787848420.542241:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787848420.542261:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.542289:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbcc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb35b expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.542305:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb35b expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.542313:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:2.0:1787848420.542331:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787848420.542335:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665200, rc 0) 00000100:00100000:2.0:1787848420.542410:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8074b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+52:10560:x1874694611456896:12345-192.168.201.26@tcp:101:bash.0 Request processed in 369us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848420.542417:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 106 00000100:00100000:2.0:1787848420.547083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848420.547353:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611457152 00000100:00100000:3.0:1787848420.547392:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611457152 00000100:00100000:3.0:1787848420.547453:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:3.0:1787848420.547464:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79298f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+52:10560:x1874694611457152:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:2.0:1787848420.548334:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79298f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+53:10560:x1874694611457152:12345-192.168.201.26@tcp:35:bash.0 Request processed in 867us (1256us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787848420.548344:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:3.0:1787848420.692272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848420.692352:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611457280 00000100:00100000:1.0:1787848420.692363:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611457280 00000100:00100000:1.0:1787848420.692435:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 107 00000100:00100000:1.0:1787848420.692446:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+53:10566:x1874694611457280:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848420.692470:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848420.692489:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbccf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb362 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.692576:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbcd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.692592:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbcd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.692603:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbcd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848420.692695:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787848420.692699:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848420.692735:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbcd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.692762:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbccf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb362 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.692781:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbcd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb362 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.692789:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:1.0:1787848420.692792:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787848420.692795:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e200, rc 0) 00000100:00100000:1.0:1787848420.692867:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:10566:x1874694611457280:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 423us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848420.692876:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 107 00000100:00100000:0.0:1787848420.697211:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848420.697300:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611457408 00000100:00100000:3.0:1787848420.697310:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611457408 00000100:00100000:3.0:1787848420.697427:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 108 00000100:00100000:3.0:1787848420.697438:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:10566:x1874694611457408:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848420.697460:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848420.697481:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb369 expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697550:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbce4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697565:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697577:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697591:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697598:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697605:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697741:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbcf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697762:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697770:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848420.697806:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787848420.697810:0:9224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848420.697826:0:9224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697838:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697847:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697853:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbce4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697860:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697866:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848420.697869:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697877:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbce4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697888:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:3.0:1787848420.697891:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848420.697902:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbce4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697909:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697924:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697931:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbceb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697935:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697941:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848420.697943:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697949:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.697957:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff541a1a00) 00010000:00010000:3.0:1787848420.697959:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848420.697962:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbceb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.699172:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.699231:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbcdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb369 expref: 56 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.699263:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbcf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb369 expref: 55 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.699271:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:3.0:1787848420.699274:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848420.699277:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236c00, rc 0) 00000100:00100000:3.0:1787848420.699349:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:10566:x1874694611457408:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1913us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848420.699357:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 108 00000100:00100000:3.0:1787848420.705314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848420.706151:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611457536 00000100:00100000:2.0:1787848420.706163:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611457536 00000100:00100000:2.0:1787848420.706252:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:2.0:1787848420.706263:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:2354:x1874694611457536:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848420.706279:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848420.706306:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cbcf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb369 expref: 55 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.706327:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:2.0:1787848420.706332:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848420.707063:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:2354:x1874694611457536:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 799us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848420.707071:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:0.0:1787848420.713855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848420.715079:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611457792 00000100:00100000:1.0:1787848420.715091:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611457792 00000100:00100000:1.0:1787848420.715181:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 109 00000100:00100000:1.0:1787848420.715198:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:10566:x1874694611457792:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848420.715220:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848420.715239:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbcf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb370 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.715351:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.715366:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb35b expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.715375:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.715408:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb35b expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.715422:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb35b expref: 55 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848420.715435:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791c1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631401472:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787848420.715697:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff504ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848420.725042:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791c1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631401472:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787848420.725073:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848420.731405:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848420.731780:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611457920 00000100:00100000:2.0:1787848420.731790:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611457920 00010000:00010000:2.0:1787848420.731835:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb35b expref: 56 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848420.731904:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:2.0:1787848420.731914:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+56:2351:x1874694611457920:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848420.731932:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848420.731939:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb35b expref: 56 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.731953:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb35b expref: 56 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.731978:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbcc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb35b expref: 56 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.731993:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:2.0:1787848420.731998:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.732007:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.732016:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.732052:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848420.732082:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.732090:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848420.732108:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:2.0:1787848420.732113:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:2351:x1874694611457920:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 201us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848420.732120:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 52 00010000:00010000:3.0:1787848420.732266:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbcf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb370 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.732283:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb370 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848420.732290:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:3.0:1787848420.732292:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787848420.732294:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42ee00, rc 0) 00000100:00100000:3.0:1787848420.732318:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:10566:x1874694611457792:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 17123us (18473us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787848420.732332:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 109 00000100:00100000:0.0:1787848420.747364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848420.747470:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611458176 00000100:00100000:1.0:1787848420.747512:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611458176 00000100:00100000:1.0:1787848420.747581:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:1.0:1787848420.747591:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:10566:x1874694611458176:12345-192.168.201.26@tcp:103:lfs.0 00010000:00010000:1.0:1787848420.747606:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848420.747634:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbc5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb346 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.747677:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:1.0:1787848420.747684:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848420.748131:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:10566:x1874694611458176:12345-192.168.201.26@tcp:103:lfs.0 Request processed in 539us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848420.748140:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:0.0:1787848420.757422:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848420.757580:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611458304 00000100:00100000:2.0:1787848420.757599:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611458304 00000100:00100000:2.0:1787848420.757703:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00100000:2.0:1787848420.757712:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:10566:x1874694611458304:12345-192.168.201.26@tcp:58:lfs.0 00010000:00010000:2.0:1787848420.757820:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.757838:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848420.757849:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787848420.758039:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787848420.758121:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:10566:x1874694611458304:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 410us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848420.758128:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00100000:3.0:1787848420.770549:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848420.771018:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611458432 00000100:00100000:1.0:1787848420.771030:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611458432 00000100:00100000:1.0:1787848420.771099:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 111 00000100:00100000:1.0:1787848420.771111:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:10566:x1874694611458432:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848420.771132:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848420.771153:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbd15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb377 expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.771219:0:9224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.771230:0:9224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbd15 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb377 expref: 55 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.771250:0:9224:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.771273:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbd15 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb377 expref: 55 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.771306:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:1.0:1787848420.771310:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787848420.771314:0:9224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbd15 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb377 expref: 55 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848420.771323:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f800, rc 0) 00000100:00100000:1.0:1787848420.771381:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:10566:x1874694611458432:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 273us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848420.771388:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 111 00000100:00100000:2.0:1787848421.062859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848421.062922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848421.063111:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611458688 00000100:00100000:3.0:1787848421.063122:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611458688 00000100:00100000:3.0:1787848421.063216:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 165 00000100:00100000:3.0:1787848421.063225:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:2354:x1874694611458688:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848421.063303:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:2354:x1874694611458688:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 79us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848421.063310:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 165 00000100:00100000:0.0:1787848421.063579:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611458944 00000100:00100000:0.0:1787848421.063585:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611458944 00000100:00100000:0.0:1787848421.063631:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:0.0:1787848421.063671:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2354:x1874694611458944:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848421.063709:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2354:x1874694611458944:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 71us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848421.063718:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:2.0:1787848421.063801:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848421.063847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848421.063869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848421.064196:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611458560 00000100:00100000:0.0:1787848421.064201:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611458560 00000100:00100000:0.0:1787848421.064237:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 301 00000100:00100000:0.0:1787848421.064244:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611458560:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848421.064277:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611458560:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 34us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848421.064284:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 301 00000100:00100000:0.0:1787848421.064381:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611459072 00000100:00100000:0.0:1787848421.064385:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611459072 00000100:00100000:0.0:1787848421.064409:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00100000:0.0:1787848421.064415:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611459072:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848421.064453:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611459072:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 38us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848421.064459:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00080000:3.0:1787848421.065109:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787848421.065116:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787848421.067094:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611458816 00000100:00100000:1.0:1787848421.067108:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611458816 00000100:00100000:1.0:1787848421.067206:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00100000:1.0:1787848421.067218:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2354:x1874694611458816:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848421.067315:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2354:x1874694611458816:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 99us (3467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848421.067322:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00080000:3.0:1787848421.068357:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787848421.423994:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787848421.753767:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787848421.753776:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787848421.753831:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787848421.753839:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787848421.753979:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4b0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631401600:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787848421.754080:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe41ac46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848421.787341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848421.787374:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611459200 00000100:00100000:3.0:1787848421.787383:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611459200 00000100:00100000:3.0:1787848421.787435:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00100000:3.0:1787848421.787445:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+56:10568:x1874694611459200:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000100:00100000:1.0:1787848421.789199:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4b0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631401600:192.168.201.26@tcp:107:hsm_cdtr.0 00000004:00000080:3.0:1787848421.789675:0:5844:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787848421.789799:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:10568:x1874694611459200:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 2353us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848421.789810:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00100000:3.0:1787848421.804953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848421.804993:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611459328 00000100:00100000:3.0:1787848421.805004:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611459328 00000100:00100000:3.0:1787848421.805063:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:3.0:1787848421.805073:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:10568:x1874694611459328:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787848421.805156:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbd1c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805183:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbd1c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805195:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbd1c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805240:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd23 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805248:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805254:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805289:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805299:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805305:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848421.805341:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787848421.805346:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848421.805359:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805370:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbd1c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805383:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbd1c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805391:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbd1c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805397:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848421.805402:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbd1c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805410:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbd1c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805422:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:3.0:1787848421.805425:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848421.805430:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbd1c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805435:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbd1c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805448:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805454:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd23 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805460:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd23 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805466:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848421.805480:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd23 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805487:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd23 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805495:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff93ff541a1a00) 00010000:00010000:3.0:1787848421.805497:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848421.805500:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd23 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805506:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd23 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805521:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805527:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805532:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805537:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848421.805539:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805545:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805552:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:3.0:1787848421.805554:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848421.805563:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.805569:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848421.805678:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:10568:x1874694611459328:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 Request processed in 606us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848421.805686:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:0.0:1787848421.830559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848421.830607:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611459584 00000100:00100000:0.0:1787848421.830617:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611459584 00000100:00100000:0.0:1787848421.830739:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:0.0:1787848421.830758:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:10568:x1874694611459584:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787848421.830781:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848421.830800:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbd31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb37e expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.830894:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.830910:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.830923:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848421.830935:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787848421.831137:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.831145:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.831152:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.831159:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148d400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848421.831174:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.831184:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.831198:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:0.0:1787848421.831207:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787848421.831213:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.831220:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.831267:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbd31 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb37e expref: 57 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.831278:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:0.0:1787848421.831280:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787848421.831284:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbd31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb37e expref: 57 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.831295:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c000, rc 0) 00000100:00100000:0.0:1787848421.831353:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+56:10568:x1874694611459584:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 598us (806us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1787848421.831360:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:1.0:1787848421.850005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848421.850157:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611459712 00000100:00100000:3.0:1787848421.850178:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611459712 00000100:00100000:3.0:1787848421.850234:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 115 00000100:00100000:3.0:1787848421.850244:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+56:10568:x1874694611459712:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787848421.850282:0:5844:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787848421.850377:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+56:10568:x1874694611459712:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 134us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848421.850384:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 115 00000001:00080000:2.0:1787848421.851190:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000004:00080000:2.0:1787848421.851235:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787848421.851253:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ff56615b40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787848421.851258:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff6ecec500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ff602a4000 00000020:00080000:2.0:1787848421.851261:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff6ecec700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ff796fa800 00000004:00080000:2.0:1787848421.851290:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:2.0:1787848421.851327:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000020:00080000:2.0:1787848421.851349:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ff6edec240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787848421.851352:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff50c79200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ff6edec0c0 00000020:00080000:2.0:1787848421.851354:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff50c79a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ff5f03b400 00000020:00080000:2.0:1787848421.851462:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787848421.851615:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787848421.851721:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631401728:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787848421.851784:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848421.851861:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631401856:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787848421.851888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848421.851928:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631401728 00000100:00100000:2.0:1787848421.851934:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631401728 00000100:00100000:2.0:1787848421.851979:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631401856 00000100:00100000:2.0:1787848421.851982:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631401856 00000100:00100000:2.0:1787848421.852006:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787848421.852014:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874694631401728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787848421.852036:0:11455:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1787848421.852070:0:11455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9066e4, atime: 0x6a9066e4, ctime: 0x6a9066e4, blocks: 0x1 00010000:00010000:2.0:1787848421.852078:0:11455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cbd46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852106:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1787848421.852110:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848421.852117:0:11455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cbd46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852134:0:11455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cbd46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852143:0:11455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cbd46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852150:0:11455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cbd46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852179:0:11455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787848421.852621:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1874694631401728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 606us (835us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787848421.852630:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787848421.852684:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787848421.852693:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1874694631401856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787848421.852707:0:11455:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1787848421.852722:0:11455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852736:0:11455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cbb63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb307 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852751:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1787848421.852754:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787848421.852758:0:11455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852787:0:11455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cbb63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb307 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852800:0:11455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cbb63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb307 expref: 7 pid: 6691 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848421.852812:0:11455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb4b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11455:1874694631401984:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848421.852870:0:11455:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e180 going to sleep for 11 seconds 00010000:00010000:2.0:1787848421.852895:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848421.852902:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cbd46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852910:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848421.852915:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cbd46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852925:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cbd46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852956:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cbd46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852963:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cbd46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.852983:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848421.852985:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848421.852987:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787848421.853020:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff7fb48b40/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787848421.853027:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631401728:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1787848421.853148:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787848421.853153:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787848421.855882:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1787848421.855898:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1787848421.860923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848421.861138:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611459968 00000100:00100000:3.0:1787848421.861150:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611459968 00010000:00010000:3.0:1787848421.861209:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cbb63 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb307 expref: 6 pid: 6691 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848421.861255:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:3.0:1787848421.861275:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f9fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611459968:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848421.861291:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848421.861297:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cbb63 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb307 expref: 6 pid: 6691 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.861330:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cbb63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb307 expref: 6 pid: 6691 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.861357:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787848421.861362:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787848421.861368:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.861379:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.861837:0:11455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cbb63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb307 expref: 6 pid: 6691 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848421.861853:0:11455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11455:1874694631401984:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848421.861876:0:11455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.861888:0:11455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.861895:0:11455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.861919:0:11455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.861927:0:11455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.861945:0:11455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787848421.862553:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1874694631401856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9860us (10662us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787848421.862564:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1787848421.862595:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848421.862602:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.862610:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848421.862615:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.862624:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.862668:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.862676:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cbd4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.862700:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848421.862702:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848421.862704:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848421.862729:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1787848421.862735:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1787848421.862756:0:3312:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93ff7fb4a1c0 x1874694631401856/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787848437 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787848421.862766:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff7fb4a1c0/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787848421.862771:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631401856:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787848421.863335:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848421.863388:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f9fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611459968:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 2112us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848421.863398:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:3.0:1787848421.863492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848421.863602:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611460096 00000100:00100000:3.0:1787848421.863608:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611460096 00000100:00100000:3.0:1787848421.863668:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 116 00000100:00100000:3.0:1787848421.863676:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10568:x1874694611460096:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787848421.863693:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848421.863696:0:7097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787848421.863717:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbcd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb362 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.863746:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:3.0:1787848421.863750:0:7097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848421.863763:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb385 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787848421.864507:0:7097:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787848421.864794:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.864808:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.864819:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.864873:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb385 expref: 16 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.864890:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb385 expref: 15 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.864897:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1900) 00010000:00010000:3.0:1787848421.864900:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848421.864903:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237400, rc 0) 00000100:00100000:3.0:1787848421.864957:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:10568:x1874694611460096:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 1281us (1464us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787848421.864966:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 116 00000100:00100000:3.0:1787848421.885859:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848421.886063:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611460352 00000100:00100000:0.0:1787848421.886076:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611460352 00000100:00100000:0.0:1787848421.886134:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00100000:0.0:1787848421.886145:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:10568:x1874694611460352:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787848421.886216:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848421.886244:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cbd5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb385 expref: 15 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886296:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1900) 00010000:00010000:0.0:1787848421.886309:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787848421.886330:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886344:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886354:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886417:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa7f2d888 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886425:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa7f2d888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886432:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa7f2d888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886754:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886763:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886770:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886775:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148d400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848421.886779:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886793:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886802:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848421.886805:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848421.886809:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886815:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbd69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886825:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa7f2d888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886830:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa7f2d888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886835:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa7f2d888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886840:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848421.886842:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa7f2d888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886848:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa7f2d888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886855:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa7f2d888 (ffff93ff48373f00) 00010000:00010000:0.0:1787848421.886858:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848421.886861:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa7f2d888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.886877:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa7f2d888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848421.886957:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10568:x1874694611460352:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 813us (1107us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787848421.886966:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00100000:2.0:1787848421.894758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848421.894880:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611460480 00000100:00100000:3.0:1787848421.894892:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611460480 00000100:00100000:3.0:1787848421.894956:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 118 00000100:00100000:3.0:1787848421.894967:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10568:x1874694611460480:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787848421.894990:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848421.895018:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb38c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.895057:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbd7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.895074:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbd7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.895085:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbd7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.895207:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cbd77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb38c expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.895226:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbd7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb38c expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.895233:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:3.0:1787848421.895236:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787848421.895240:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236800, rc 0) 00000100:00100000:3.0:1787848421.895362:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:10568:x1874694611460480:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 396us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848421.895379:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 118 00000100:00100000:1.0:1787848421.908939:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848421.912720:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611460736 00000100:00100000:0.0:1787848421.912737:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611460736 00000100:00100000:0.0:1787848421.912818:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 119 00000100:00100000:0.0:1787848421.912828:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:10568:x1874694611460736:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787848421.912938:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.912955:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848421.912968:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787848421.913936:0:9224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787848421.913954:0:9224:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370825313640ns, next at 371825309080ns, rc = 0 00000004:00010000:1.0:1787848421.914060:0:9224:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba7df4b3 reply state 000000009ef049ef transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848421.914085:0:9224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787848421.914205:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:10568:x1874694611460736:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 1375us (5276us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787848421.914213:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 119 00000100:00100000:1.0:1787848421.919548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:3.0:1787848421.919821:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.919838:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.919847:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.919853:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848421.919861:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.919870:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.919891:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:3.0:1787848421.919894:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787848421.919899:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848421.919906:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbd85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848421.920362:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611460864 00000100:00100000:2.0:1787848421.920373:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611460864 00000100:00100000:2.0:1787848421.920440:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 120 00000100:00100000:2.0:1787848421.920450:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:10568:x1874694611460864:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848421.920492:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848421.920511:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbd8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb393 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.920573:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbd8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb393 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.920588:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbd8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb393 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.920607:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:2.0:1787848421.920628:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787848421.920632:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665a00, rc 0) 00000100:00100000:2.0:1787848421.920745:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:10568:x1874694611460864:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 297us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848421.920752:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 120 00000100:00100000:2.0:1787848421.929765:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848421.929875:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611460992 00000100:00100000:1.0:1787848421.929885:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611460992 00000100:00100000:1.0:1787848421.929945:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:1.0:1787848421.929956:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2351:x1874694611460992:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787848421.930338:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611460992:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 384us (583us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787848421.930349:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:1.0:1787848421.936105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848421.936189:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611461248 00000100:00100000:2.0:1787848421.936198:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611461248 00000100:00100000:2.0:1787848421.936251:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:2.0:1787848421.936267:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:10568:x1874694611461248:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787848421.936498:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10568:x1874694611461248:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 238us (402us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787848421.936506:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:0.0:1787848421.953032:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848421.953156:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611461504 00000100:00100000:3.0:1787848421.953194:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611461504 00000100:00100000:3.0:1787848421.953254:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:3.0:1787848421.953271:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79249680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10568:x1874694611461504:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787848421.953380:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79249680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10568:x1874694611461504:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 111us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848421.953403:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:0.0:1787848421.957673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848421.957865:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611461632 00000100:00100000:1.0:1787848421.957876:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611461632 00000100:00100000:1.0:1787848421.957934:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00100000:1.0:1787848421.957945:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79249a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10568:x1874694611461632:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787848421.957965:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848421.957985:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cbd93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb39a expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848421.958054:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbd9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848421.958067:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbd9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848421.958097:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbd9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848421.958135:0:9224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848421.958154:0:9224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbd9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848421.958191:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cbd93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb39a expref: 20 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848421.958208:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbd9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb39a expref: 19 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848421.958217:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:1.0:1787848421.958221:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787848421.958224:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e600, rc 0) 00000100:00100000:1.0:1787848421.958405:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79249a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10568:x1874694611461632:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 460us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848421.958413:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00100000:1.0:1787848421.966092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848421.966215:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611461760 00000100:00100000:2.0:1787848421.966227:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611461760 00000100:00100000:2.0:1787848421.966290:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:2.0:1787848421.966301:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611461760:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848421.966317:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848421.966337:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7cabbbb/0x9aeb41e0543cbda1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3a1 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787848421.966361:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9066e6, blocks: 0x1 00010000:00010000:2.0:1787848421.966383:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1787848421.966388:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848421.966398:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cabbbb/0x9aeb41e0543cbda1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a1 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.966435:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7cabbbb/0x9aeb41e0543cbda1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a1 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848421.966448:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664000, rc 0) 00000100:00100000:2.0:1787848421.966769:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611461760:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 468us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848421.966776:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:0.0:1787848421.973113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848421.973220:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611462016 00000100:00100000:3.0:1787848421.973230:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611462016 00000100:00100000:3.0:1787848421.973301:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 123 00000100:00100000:3.0:1787848421.973312:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10568:x1874694611462016:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787848421.973491:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10568:x1874694611462016:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 178us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848421.973500:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 123 00000100:00100000:0.0:1787848421.982932:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848421.983278:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611462144 00000100:00100000:1.0:1787848421.983288:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611462144 00000100:00100000:1.0:1787848421.983342:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:1.0:1787848421.983351:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:10568:x1874694611462144:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787848421.983368:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848421.983385:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3a8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848421.983437:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7cabbbb/0x9aeb41e0543cbda1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a1 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848421.983447:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848421.983460:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848421.983467:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848421.983630:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7cabbbb/0x9aeb41e0543cbda1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a1 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848421.983684:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7cabbbb/0x9aeb41e0543cbda1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a1 expref: 8 pid: 6690 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848421.983697:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874694631402112:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787848421.983774:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fbe1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848422.001123:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874694631402112:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848422.001159:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.001190:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f200, rc 0) 00000100:00100000:2.0:1787848422.001249:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:10568:x1874694611462144:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 17899us (18325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848422.001265:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:1.0:1787848422.001611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848422.001752:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611462272 00000100:00100000:2.0:1787848422.001759:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611462272 00010000:00010000:2.0:1787848422.001788:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cabbbb/0x9aeb41e0543cbda1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a1 expref: 8 pid: 6690 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848422.001818:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:2.0:1787848422.001826:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611462272:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848422.001839:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848422.001871:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7cabbbb/0x9aeb41e0543cbda1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a1 expref: 8 pid: 6690 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.001884:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7cabbbb/0x9aeb41e0543cbda1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a1 expref: 8 pid: 6690 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.001907:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7cabbbb/0x9aeb41e0543cbda1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a1 expref: 8 pid: 6690 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.001920:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848422.001924:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848422.001933:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.001944:0:8522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.001977:0:8522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848422.001993:0:8522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2ed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8522:1874694631402240:192.168.201.26@tcp:105: 00000100:00100000:2.0:1787848422.002047:0:8522:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7954e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787848422.016810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848422.017004:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611462400 00000100:00100000:1.0:1787848422.017014:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611462400 00002000:00100000:1.0:1787848422.017057:0:6696:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93ff79248780 x1874694611462400/t0(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:128/0 lens 504/0 e 0 to 0 dl 1787848433 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787848422.017068:0:6696:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff79248780 with x1874694611462400 ext(0->12) 00002000:00010000:1.0:1787848422.017073:0:6696:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff79248780 00000100:00100000:1.0:1787848422.017105:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:1.0:1787848422.017121:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611462400:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787848422.017770:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:2352:x1874694611462400:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 Request processed in 648us (968us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787848422.017779:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00002000:00100000:1.0:1787848422.017787:0:6696:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93ff79248780 x1874694611462400/t4294967309(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:128/0 lens 504/448 e 0 to 0 dl 1787848433 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787848422.017795:0:6696:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff79248780 with x1874694611462400 ext(0->12) 00002000:00010000:1.0:1787848422.017799:0:6696:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff79248780 00000100:00100000:2.0:1787848422.018316:0:8522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2ed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8522:1874694631402240:192.168.201.26@tcp:105: 00010000:00010000:2.0:1787848422.018345:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848422.018387:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2352:x1874694611462272:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 16561us (16776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848422.018405:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:0.0:1787848422.023548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848422.023775:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611462528 00000100:00100000:2.0:1787848422.023786:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611462528 00000100:00100000:2.0:1787848422.023870:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 124 00000100:00100000:2.0:1787848422.023883:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10568:x1874694611462528:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 00000100:00080000:3.0:1787848422.024025:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848422.142148:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:10568:x1874694611462528:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 Request processed in 118256us (118599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848422.142179:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 124 00000001:00080000:2.0:1787848422.142215:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1787848422.142221:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:2.0:1787848422.142247:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1787848422.142252:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1787848422.142309:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:3.0:1787848422.142321:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1787848422.142563:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848422.142580:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631402368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787848422.142664:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848422.142772:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631402368 00000100:00100000:1.0:1787848422.142779:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631402368 00000100:00100000:1.0:1787848422.142824:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787848422.142832:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874694631402368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787848422.142976:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787848422.142980:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787848422 00002000:00010000:1.0:1787848422.142982:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787848422.142984:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787848422 -> 1787848422 00002000:00010000:1.0:1787848422.142986:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787848422.143023:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1874694631402368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (386us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787848422.143030:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1787848422.143067:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff7fb8d680/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787848422.143073:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631402368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787848422.161988:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848422.162237:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611462656 00000100:00100000:2.0:1787848422.162248:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611462656 00000100:00100000:2.0:1787848422.162322:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:2.0:1787848422.162331:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2351:x1874694611462656:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787848422.244871:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787848422.244887:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1787848422.245218:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611462656:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 Request processed in 82881us (83233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848422.245228:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:0.0:1787848422.248889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848422.251756:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611462912 00000100:00100000:1.0:1787848422.251791:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611462912 00000100:00100000:1.0:1787848422.251867:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:1.0:1787848422.251879:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:10568:x1874694611462912:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787848422.251949:0:9224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848422.251979:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbd9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb39a expref: 15 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.252003:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:1.0:1787848422.252009:0:9224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787848422.252039:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cbdaf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.252053:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cbdaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.252063:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cbdaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787848422.252352:0:9224:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fd9abec reply state 000000007d591243 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cbdaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848422.252362:0:9224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787848422.252501:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:10568:x1874694611462912:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 624us (3620us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787848422.252509:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:0.0:1787848422.269299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848422.269515:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611463040 00000100:00100000:1.0:1787848422.269525:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611463040 00000100:00100000:1.0:1787848422.269586:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:1.0:1787848422.269596:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611463040:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787848422.269936:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787848422.269940:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787848422 -> 1787848421 00002000:00010000:1.0:1787848422.269942:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787848420 00002000:00010000:1.0:1787848422.269944:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787848422 -> 1787848421 00002000:00010000:1.0:1787848422.269946:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787848422.270002:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611463040:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 408us (712us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787848422.270009:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00010000:00010000:3.0:1787848422.272663:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cbdaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.272683:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cbdaf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.272691:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cbdaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.272697:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848422.272702:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cbdaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.272710:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cbdaf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.272746:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:3.0:1787848422.272749:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848422.272755:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cbdaf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.272761:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cbdaf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848422.290277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848422.290374:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611463296 00000100:00100000:0.0:1787848422.290394:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611463296 00000100:00100000:0.0:1787848422.290460:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:0.0:1787848422.290471:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:10568:x1874694611463296:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787848422.290548:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.290565:0:7097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbd7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb38c expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.290574:0:7097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.290607:0:7097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbd7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb38c expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.290620:0:7097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbd7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb38c expref: 15 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848422.290635:0:7097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7097:1874694631402496:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848422.290762:0:7097:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6a3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787848422.298917:0:7097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7097:1874694631402496:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848422.298960:0:7097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848422.312078:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848422.312258:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611463424 00000100:00100000:3.0:1787848422.312269:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611463424 00010000:00010000:3.0:1787848422.312314:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbd7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb38c expref: 16 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848422.312360:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:3.0:1787848422.312370:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:2351:x1874694611463424:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848422.312384:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848422.312391:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbd7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb38c expref: 16 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.312414:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbd7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb38c expref: 16 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.312437:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbd7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb38c expref: 16 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.312461:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:3.0:1787848422.312470:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.312493:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.312501:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.312537:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848422.312598:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:2351:x1874694611463424:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 229us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848422.312606:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 55 00010000:00010000:1.0:1787848422.313191:0:7097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.313201:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.313230:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.313237:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.313244:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.313250:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848422.313254:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.313260:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.313280:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:1.0:1787848422.313282:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787848422.313287:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.313293:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbdb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848422.313349:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10568:x1874694611463296:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 Request processed in 22880us (23082us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787848422.313357:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:1.0:1787848422.320708:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848422.321037:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611463552 00000100:00100000:3.0:1787848422.321048:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611463552 00000100:00100000:3.0:1787848422.321105:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:3.0:1787848422.321114:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611463552:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787848422.321168:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.321189:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.321197:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787848422.321202:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787848422.321207:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.321240:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.321271:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 7 pid: 6689 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848422.321286:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874694631402624:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848422.321374:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6eceee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787848422.325954:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874694631402624:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848422.325986:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848422.329436:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848422.329747:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611463680 00000100:00100000:3.0:1787848422.329759:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611463680 00010000:00010000:3.0:1787848422.329801:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 8 pid: 6689 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848422.329843:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:3.0:1787848422.329854:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611463680:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848422.329868:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848422.329905:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 8 pid: 6689 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.329920:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 8 pid: 6689 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.329952:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cbda8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3a8 expref: 8 pid: 6689 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.329984:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787848422.329989:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787848422.329994:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.330005:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.330036:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848422.330104:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611463680:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 251us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848422.330111:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 56 00010000:00010000:1.0:1787848422.330292:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.330303:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.330334:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.330341:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.330349:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.330370:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848422.330374:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.330382:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.330394:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.330401:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036473462/0x9aeb41e0543cbdbd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848422.330448:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611463552:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 Request processed in 9335us (9750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848422.330456:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:2.0:1787848422.339364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848422.339734:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611463936 00000100:00100000:0.0:1787848422.339746:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611463936 00000100:00100000:0.0:1787848422.339805:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 127 00000100:00100000:0.0:1787848422.339816:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10568:x1874694611463936:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787848422.339908:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbdc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.339925:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbdc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.339946:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbdc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.340223:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.340234:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbd8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb393 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.340242:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.340275:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbd8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb393 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.340290:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbd8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb393 expref: 15 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848422.340305:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631402752:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848422.340393:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f6a3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787848422.343737:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631402752:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848422.343769:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848422.344136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848422.347906:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611464064 00000100:00100000:3.0:1787848422.347923:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611464064 00010000:00010000:3.0:1787848422.348035:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbd8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb393 expref: 16 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848422.348131:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:3.0:1787848422.348141:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:2352:x1874694611464064:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848422.348168:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848422.348175:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbd8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb393 expref: 16 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.348189:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbd8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb393 expref: 16 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.348231:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbd8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb393 expref: 16 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.348247:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:3.0:1787848422.348253:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.348262:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.348269:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.348304:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848422.348393:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:2352:x1874694611464064:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 241us (4245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848422.348401:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 57 00010000:00010000:2.0:1787848422.349335:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.349359:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787848422.349566:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787848422.349765:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787848422.349812:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787848422.349921:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874694631402880:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787848422.349979:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848422.350010:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff41376000 going to sleep for 11 seconds 00000100:00100000:1.0:1787848422.350346:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631402880 00000100:00100000:1.0:1787848422.350353:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631402880 00000100:00100000:1.0:1787848422.350414:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787848422.350424:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1874694631402880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787848422.350519:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1874694631402880:12345-0@lo:1000:mdt00_001.0 Request processed in 97us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848422.350526:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787848422.353716:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787848422.353728:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff7fb4a1c0, transno 4294967307 00000004:00080000:2.0:1787848422.353742:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff7fb8d680, transno 4294967310 00000100:00100000:2.0:1787848422.353751:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874694631402880:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787848422.354295:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787848422.354374:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874694631403008:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787848422.354437:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848422.354730:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6edec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848422.354996:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631403008 00000100:00100000:2.0:1787848422.355002:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631403008 00000100:00100000:2.0:1787848422.355043:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848422.355051:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1874694631403008:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787848422.355229:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1874694631403008:12345-0@lo:1000:mdt00_001.0 Request processed in 178us (792us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787848422.355236:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848422.355276:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874694631403008:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787848422.355307:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355323:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355331:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355337:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148da00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848422.355342:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355349:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355364:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff541a1a00) 00010000:00010000:2.0:1787848422.355367:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787848422.355372:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355377:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbdcb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355404:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355410:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355415:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355419:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848422.355426:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355431:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355438:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:2.0:1787848422.355440:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787848422.355977:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbd15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb377 expref: 18 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.355992:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbd15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb377 expref: 18 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.356001:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbd15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb377 expref: 18 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.356030:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbd15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb377 expref: 18 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848422.356041:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631403136:192.168.201.26@tcp:105: 00000100:00100000:2.0:1787848422.356111:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff44eec480 going to sleep for 11 seconds 00000100:00100000:3.0:1787848422.359988:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631403136:192.168.201.26@tcp:105: 00010000:00010000:3.0:1787848422.360027:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360038:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbd0e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360070:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbdd2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360087:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbdd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360119:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbdd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360130:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbdd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360138:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbdd2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360145:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbdd2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360151:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848422.360168:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbdd2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360176:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbdd2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360188:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:3.0:1787848422.360191:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848422.360194:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbdd2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360199:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236800/0x9aeb41e0543cbdd2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360209:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbdc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360215:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbdc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360227:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbdc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360232:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148ca00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848422.360235:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbdc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360242:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbdc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360250:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:3.0:1787848422.360252:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787848422.360255:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbdc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.360260:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cbdc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848422.360558:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10568:x1874694611463936:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 20743us (21204us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787848422.360569:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 127 00000020:00080000:3.0:1787848422.360575:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787848422.362783:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848422.362892:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611464192 00000100:00100000:3.0:1787848422.362901:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611464192 00000100:00100000:3.0:1787848422.362957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:3.0:1787848422.362966:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10566:x1874694611464192:12345-192.168.201.26@tcp:49:lfs.0 00000100:00100000:3.0:1787848422.363101:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10566:x1874694611464192:12345-192.168.201.26@tcp:49:lfs.0 Request processed in 136us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848422.363127:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 31 00000040:00080000:1.0:1787848422.365080:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787848422.365087:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787848422.365580:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787848422.365594:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787848422.373047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848422.373090:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848422.373195:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611464704 00000100:00100000:2.0:1787848422.373205:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611464704 00000100:00100000:2.0:1787848422.373260:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:2.0:1787848422.373271:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff47b4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:10568:x1874694611464704:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787848422.373950:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787848422.374057:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787848422.374099:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbdd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.374116:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbdd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.374126:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbdd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.374134:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbdd9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.374139:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbdd9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.374145:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbdd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.374168:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787848422.374261:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff47b4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:10568:x1874694611464704:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 990us (1168us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787848422.374269:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 32 00000020:00080000:2.0:1787848422.374274:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787848422.374593:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848422.374600:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbdd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.374607:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848422.374611:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbdd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.374619:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbdd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.374631:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ff53a89900) 00010000:00010000:0.0:1787848422.374634:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787848422.374668:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbdd9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.374674:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbdd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.374689:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848422.374690:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848422.374692:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848422.374816:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611464448 00000100:00100000:3.0:1787848422.374822:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611464448 00000100:00100000:3.0:1787848422.374867:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 128 00000100:00100000:3.0:1787848422.374876:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:10566:x1874694611464448:12345-192.168.201.26@tcp:58:lfs.0 00000040:00080000:3.0:1787848422.375044:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787848422.375104:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:10566:x1874694611464448:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 229us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848422.375112:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 128 00000100:00100000:0.0:1787848422.422590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848422.422939:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611464832 00000100:00100000:1.0:1787848422.422950:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611464832 00000100:00100000:1.0:1787848422.423019:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 129 00000100:00100000:1.0:1787848422.423030:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:10570:x1874694611464832:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848422.423057:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848422.423082:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbde0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3af expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.423167:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cbde7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.423185:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cbde7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.423198:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cbde7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.423215:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbdee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.423222:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbdee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848422.423230:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbdee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.424625:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.424670:0:7097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb370 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.424679:0:7097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.424731:0:7097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb370 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848422.424747:0:7097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb370 expref: 21 pid: 5843 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848422.424764:0:7097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7097:1874694631403264:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848422.424876:0:7097:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff44eec180 going to sleep for 11 seconds 00000100:00100000:0.0:1787848422.428848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848422.428922:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611465088 00000100:00100000:3.0:1787848422.428931:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611465088 00000100:00100000:3.0:1787848422.428991:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:3.0:1787848422.429002:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:5593:x1874694611465088:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787848422.429259:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:5593:x1874694611465088:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 258us (421us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787848422.429267:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:2.0:1787848422.429947:0:7097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7097:1874694631403264:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848422.429974:0:7097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848422.432794:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848422.432894:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611465216 00000100:00100000:3.0:1787848422.432904:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611465216 00010000:00010000:3.0:1787848422.432945:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb370 expref: 23 pid: 5843 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848422.432984:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:3.0:1787848422.432993:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f430b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:2351:x1874694611465216:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848422.433010:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848422.433016:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb370 expref: 23 pid: 5843 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.433041:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb370 expref: 23 pid: 5843 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.433065:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbd00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb370 expref: 23 pid: 5843 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.433081:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:3.0:1787848422.433086:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.433096:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.433104:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848422.433136:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848422.433255:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f430b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:2351:x1874694611465216:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 262us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848422.433263:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 58 00010000:00010000:0.0:1787848422.433328:0:7097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433336:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848422.433376:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787848422.433397:0:7097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848422.433423:0:7097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433436:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433452:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cbde7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433459:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cbde7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433470:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cbde7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433475:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848422.433479:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cbde7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433486:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cbde7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433495:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848422.433497:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848422.433502:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cbde7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433508:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cbde7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433518:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbdee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433532:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbdee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433537:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbdee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433542:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42fa00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848422.433545:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbdee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433551:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbdee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433558:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ff43951d00) 00010000:00010000:0.0:1787848422.433560:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848422.433562:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbdee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433568:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbdee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433602:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbde0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3af expref: 22 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433615:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3af expref: 21 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848422.433622:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:0.0:1787848422.433624:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848422.433631:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665e00, rc 0) 00000100:00100000:0.0:1787848422.433702:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:10570:x1874694611464832:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 10674us (11123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848422.433709:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 129 00010000:00010000:2.0:1787848422.447831:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787848423.411735:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787848423.411744:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787848423.411795:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787848423.411806:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787848423.411932:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79443c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631403392:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787848423.412027:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463fd840 going to sleep for 11 seconds 00000001:00080000:3.0:1787848423.431178:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1787848423.431195:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787848423.431200:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1787848423.432308:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79443c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631403392:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787848423.432585:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848423.433603:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611465344 00000100:00100000:1.0:1787848423.433612:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611465344 00000100:00100000:1.0:1787848423.433681:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 130 00000100:00100000:1.0:1787848423.433691:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f431680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:10581:x1874694611465344:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787848423.433729:0:5843:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787848423.433835:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f431680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:10581:x1874694611465344:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 144us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848423.433843:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 130 00000100:00100000:1.0:1787848423.437881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848423.437985:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611465600 00000100:00100000:2.0:1787848423.437996:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611465600 00000100:00100000:2.0:1787848423.438066:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 131 00000100:00100000:2.0:1787848423.438077:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79443c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:10581:x1874694611465600:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848423.438101:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848423.438122:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbdfc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3b6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.438237:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbe03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.438252:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbe03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.438279:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbe03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848423.438291:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787848423.438426:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbdfc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3b6 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.438444:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbe03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3b6 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.438712:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:2.0:1787848423.438715:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787848423.438718:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664000, rc 0) 00000100:00100000:2.0:1787848423.438783:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79443c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:10581:x1874694611465600:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 707us (910us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787848423.438791:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 131 00000100:00100000:1.0:1787848423.445221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848423.445289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848423.445347:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611465984 00000100:00100000:2.0:1787848423.445356:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611465984 00000100:00100000:2.0:1787848423.445421:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:2.0:1787848423.445431:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:2353:x1874694611465984:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848423.445510:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848423.445537:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbe03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3b6 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.445553:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:2.0:1787848423.445558:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848423.445614:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:2353:x1874694611465984:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 184us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848423.445622:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:0.0:1787848423.446832:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611465856 00000100:00100000:0.0:1787848423.446843:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611465856 00000100:00100000:0.0:1787848423.446890:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 132 00000100:00100000:0.0:1787848423.446900:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff521903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:10581:x1874694611465856:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787848423.446972:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848423.446989:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848423.446998:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848423.447182:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848423.447189:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848423.447195:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848423.447200:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148da00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848423.447204:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848423.447224:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848423.447235:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:0.0:1787848423.447238:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787848423.447242:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848423.447248:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848423.447389:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff521903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:10581:x1874694611465856:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 490us (2176us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787848423.447395:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 132 00000040:00080000:2.0:1787848423.447706:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787848423.447712:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787848423.448211:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787848423.448220:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787848423.454823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848423.454852:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611466240 00000100:00100000:3.0:1787848423.454861:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611466240 00000100:00100000:3.0:1787848423.454909:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:3.0:1787848423.454919:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:10581:x1874694611466240:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787848423.455172:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:10581:x1874694611466240:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 253us (357us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787848423.455180:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 34 00010000:00010000:0.0:1787848423.474631:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787848423.480347:0:12128:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787848423.480356:0:12128:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787848423.480399:0:12128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787848423.480405:0:12128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787848423.756617:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848423.759733:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611466496 00000100:00100000:1.0:1787848423.759747:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611466496 00000100:00100000:1.0:1787848423.759821:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 133 00000100:00100000:1.0:1787848423.759833:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:10594:x1874694611466496:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848423.759862:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848423.759888:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbe18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3bd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848423.760010:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbe1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848423.760026:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbe1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848423.760045:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbe1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848423.760060:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787848423.760218:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbe18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3bd expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848423.760240:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbe1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3bd expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848423.760249:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:1.0:1787848423.760253:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787848423.760256:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e200, rc 0) 00000100:00100000:1.0:1787848423.760341:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:10594:x1874694611466496:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 510us (3732us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787848423.760348:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 133 00000100:00100000:1.0:1787848423.768061:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848423.768110:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611466624 00000100:00100000:2.0:1787848423.768124:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611466624 00000100:00100000:2.0:1787848423.768203:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 134 00000100:00100000:2.0:1787848423.768213:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:10594:x1874694611466624:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:2.0:1787848423.768286:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.768304:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.768317:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.768344:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.768351:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.768358:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.768378:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848423.768383:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.768390:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.768403:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:2.0:1787848423.768407:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787848423.768411:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848423.768418:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848423.768510:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:10594:x1874694611466624:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 296us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848423.768518:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 134 00000100:00100000:3.0:1787848423.800180:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631403776:0@lo:400:kworker.0 00000100:00100000:3.0:1787848423.800255:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848423.800316:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848423.800323:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7929b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631403904:0@lo:400:kworker.0 00000100:00100000:3.0:1787848423.800365:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848423.800417:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631403776 00000100:00100000:3.0:1787848423.800425:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631403776 00000100:00100000:3.0:1787848423.800481:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787848423.800492:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff559b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631403776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848423.800545:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff559b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631403776:12345-0@lo:400:kworker.0 Request processed in 55us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848423.800552:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787848423.800576:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631403904 00000100:00100000:3.0:1787848423.800580:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631403904 00000100:00100000:3.0:1787848423.800610:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787848423.800617:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631403904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848423.800673:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631403904:12345-0@lo:400:kworker.0 Request processed in 56us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848423.800679:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1787848423.800695:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848423.800701:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848423.800730:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787848423.800736:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787848423.800761:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff7fb48b40, transno 4294967304 00000100:00100000:3.0:1787848423.800772:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7929b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631403904:0@lo:400:kworker.0 00000100:00100000:3.0:1787848423.800786:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631403776:0@lo:400:kworker.0 00000100:00100000:2.0:1787848423.805174:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7929b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631403520:0@lo:400:kworker.0 00000100:00100000:2.0:1787848423.805255:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848423.805311:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5317de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631404032:0@lo:400:kworker.0 00000100:00100000:2.0:1787848423.805339:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848423.805375:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787848423.805382:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79299680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631403648:0@lo:400:kworker.0 00000100:00100000:3.0:1787848423.807330:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631403520 00000100:00100000:3.0:1787848423.807344:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631403520 00000100:00100000:3.0:1787848423.807410:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787848423.807435:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4577a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631403520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848423.807541:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4577a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631403520:12345-0@lo:400:kworker.0 Request processed in 121us (2286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848423.807548:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787848423.808221:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848423.808273:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff444a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631404160:0@lo:400:kworker.0 00000100:00100000:2.0:1787848423.808308:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848423.808349:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7929b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631403520:0@lo:400:kworker.0 00000100:00100000:2.0:1787848423.808379:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631404160 00000100:00100000:2.0:1787848423.808383:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631404160 00000100:00100000:2.0:1787848423.808433:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787848423.808441:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631404160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848423.808482:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631404160:12345-0@lo:400:kworker.0 Request processed in 42us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848423.808489:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1787848423.808509:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787848423.808530:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff444a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631404160:0@lo:400:kworker.0 00000100:00100000:0.0:1787848423.808625:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631404032 00000100:00100000:0.0:1787848423.808630:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631404032 00000100:00100000:0.0:1787848423.808690:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631403648 00000100:00100000:0.0:1787848423.808694:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631403648 00000100:00100000:0.0:1787848423.808711:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787848423.808718:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631404032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848423.808728:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787848423.808736:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631403648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848423.808757:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631404032:12345-0@lo:400:kworker.0 Request processed in 40us (3417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848423.808764:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787848423.808765:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631403648:12345-0@lo:400:kworker.0 Request processed in 32us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848423.808771:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1787848423.809207:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848423.809231:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79299680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631403648:0@lo:400:kworker.0 00000100:00100000:3.0:1787848423.809241:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5317de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631404032:0@lo:400:kworker.0 00000100:00100000:2.0:1787848423.891824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848423.891924:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611466752 00000100:00100000:3.0:1787848423.891933:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611466752 00000100:00100000:3.0:1787848423.892005:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:3.0:1787848423.892014:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611466752:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:3.0:1787848423.892034:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848423.892057:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc8b823c/0x9aeb41e0543cbe34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3c4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787848423.892078:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9066e5, atime: 0x6a9066e4, ctime: 0x6a9066e5, blocks: 0xb 00010000:00010000:3.0:1787848423.892095:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1787848423.892098:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848423.892106:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc8b823c/0x9aeb41e0543cbe34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3c4 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848423.892169:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc8b823c/0x9aeb41e0543cbe34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3c4 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848423.892183:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236800, rc 0) 00000100:00100000:3.0:1787848423.892247:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2353:x1874694611466752:12345-192.168.201.26@tcp:101:cat.0 Request processed in 234us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848423.892254:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00080000:2.0:1787848423.893403:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787848423.896870:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848423.898581:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611466880 00000100:00100000:0.0:1787848423.898600:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611466880 00002000:00100000:0.0:1787848423.898707:0:6695:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93ff444a43c0 x1874694611466880/t0(0) o3->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:129/0 lens 488/0 e 0 to 0 dl 1787848434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787848423.898738:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff444a43c0 with x1874694611466880 ext(0->4095) 00002000:00010000:0.0:1787848423.898745:0:6695:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff444a43c0 00000100:00100000:0.0:1787848423.898784:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:0.0:1787848423.898793:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611466880:12345-192.168.201.26@tcp:3:cat.0 00000100:00100000:0.0:1787848423.899058:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611466880:12345-192.168.201.26@tcp:3:cat.0 Request processed in 264us (2198us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787848423.899066:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 3 00002000:00100000:0.0:1787848423.899074:0:6695:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93ff444a43c0 x1874694611466880/t0(0) o3->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:129/0 lens 488/4536 e 0 to 0 dl 1787848434 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787848423.899082:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff444a43c0 with x1874694611466880 ext(0->4095) 00002000:00010000:0.0:1787848423.899086:0:6695:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff444a43c0 00000100:00100000:0.0:1787848424.304682:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848424.304716:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631404288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848424.304794:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848424.305729:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787848424.305743:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f430780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631404416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848424.305788:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848424.305874:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631404288 00000100:00100000:0.0:1787848424.305882:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631404288 00000100:00100000:0.0:1787848424.305934:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631404416 00000100:00100000:0.0:1787848424.305937:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631404416 00000100:00100000:0.0:1787848424.305954:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787848424.305962:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631404288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787848424.305997:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848424.306041:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631404288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848424.306048:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787848424.306090:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787848424.306097:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874694631404416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787848424.306131:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848424.306166:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874694631404416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848424.306172:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787848424.306225:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f430780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631404416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848424.306679:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631404288:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787848424.497212:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787848425.522164:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787848425.522181:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787848425.522221:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787848425.522231:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787848425.540327:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848426.179547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848426.179593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848426.179625:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848426.179666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848426.179691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848426.179721:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611467392 00000100:00100000:3.0:1787848426.179731:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611467392 00000100:00100000:3.0:1787848426.179783:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611467264 00000100:00100000:3.0:1787848426.179787:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611467264 00000100:00100000:3.0:1787848426.179814:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 95 00000100:00100000:3.0:1787848426.179825:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2353:x1874694611467392:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848426.179906:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2353:x1874694611467392:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 83us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848426.179914:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 95 00000100:00100000:3.0:1787848426.179929:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:3.0:1787848426.179937:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611467264:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848426.179976:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611467264:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 40us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848426.179983:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:3.0:1787848426.180003:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611467008 00000100:00100000:3.0:1787848426.180007:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611467008 00000100:00100000:3.0:1787848426.180030:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 303 00000100:00100000:3.0:1787848426.180037:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2353:x1874694611467008:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848426.180061:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2353:x1874694611467008:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848426.180068:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 303 00000100:00080000:3.0:1787848426.180110:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848426.180114:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787848426.180267:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611467136 00000100:00100000:0.0:1787848426.180272:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611467136 00000100:00100000:0.0:1787848426.180318:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611467520 00000100:00100000:0.0:1787848426.180321:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611467520 00000100:00100000:0.0:1787848426.180344:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 170 00000100:00100000:0.0:1787848426.180352:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:2353:x1874694611467136:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848426.180390:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:2353:x1874694611467136:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 39us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848426.180397:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 170 00000100:00100000:0.0:1787848426.180412:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 171 00000100:00100000:0.0:1787848426.180419:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2353:x1874694611467520:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848426.180444:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2353:x1874694611467520:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 26us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848426.180450:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 171 00000100:00080000:3.0:1787848426.184866:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787848426.549698:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787848427.470407:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787848427.470955:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787848427.473486:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:2.0:1787848427.473501:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787848427.473524:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ff41376540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787848427.473529:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff52c8fe00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ff41376000 00000020:00080000:2.0:1787848427.473533:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff52c8fa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ff52195400 00000020:00080000:0.0:1787848427.473760:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787848427.473956:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1787848427.567818:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848428.592227:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848428.911887:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631404800:0@lo:400:kworker.0 00000100:00100000:1.0:1787848428.911964:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848428.912152:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631404544:0@lo:400:kworker.0 00000100:00100000:2.0:1787848428.912190:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848428.912206:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631404672:0@lo:400:kworker.0 00000100:00100000:2.0:1787848428.912236:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631404544 00000100:00100000:2.0:1787848428.912248:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631404544 00000100:00100000:0.0:1787848428.912250:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848428.912279:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631404800 00000100:00100000:0.0:1787848428.912283:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631404800 00000100:00100000:0.0:1787848428.912323:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631404672 00000100:00100000:0.0:1787848428.912326:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631404672 00000100:00100000:0.0:1787848428.912348:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787848428.912951:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631404800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848428.913100:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787848428.913108:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631404544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848428.913148:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631404544:12345-0@lo:400:kworker.0 Request processed in 41us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848428.913155:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787848428.913206:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631404544:0@lo:400:kworker.0 00000100:00100000:2.0:1787848428.913246:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787848428.913254:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631404672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848428.913689:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631404672:12345-0@lo:400:kworker.0 Request processed in 435us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848428.913696:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787848428.913730:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631404928:0@lo:400:kworker.0 00000100:00100000:2.0:1787848428.913760:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848428.913799:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631404928 00000100:00100000:2.0:1787848428.913805:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631404928 00000100:00100000:2.0:1787848428.913837:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787848428.913844:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631404928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848428.913880:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631404928:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848428.913887:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787848428.913916:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631404928:0@lo:400:kworker.0 00000100:00080000:2.0:1787848428.913956:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787848428.913962:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848428.915037:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631404672:0@lo:400:kworker.0 00000100:00100000:0.0:1787848428.920139:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631404800:12345-0@lo:400:kworker.0 Request processed in 7186us (8165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848428.920156:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787848428.921359:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631404800:0@lo:400:kworker.0 00000100:00100000:2.0:1787848428.921736:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631405056:0@lo:400:kworker.0 00000100:00100000:2.0:1787848428.921803:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848428.921907:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631405056 00000100:00100000:0.0:1787848428.921914:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631405056 00000100:00100000:0.0:1787848428.921999:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787848428.922009:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631405056:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787848428.922100:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848428.922670:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631405184:0@lo:400:kworker.0 00000100:00100000:1.0:1787848428.922711:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848428.922760:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631405184 00000100:00100000:1.0:1787848428.922764:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631405184 00000100:00100000:1.0:1787848428.922803:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787848428.922811:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631405184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848428.922850:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631405184:12345-0@lo:400:kworker.0 Request processed in 41us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848428.922858:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1787848428.922890:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787848428.922906:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787848428.922912:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787848428.922931:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631405184:0@lo:400:kworker.0 00000100:00100000:0.0:1787848428.923245:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631405056:12345-0@lo:400:kworker.0 Request processed in 1236us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848428.923253:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787848428.923465:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631405056:0@lo:400:kworker.0 00000100:00100000:3.0:1787848429.424170:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848429.424196:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631405312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848429.424272:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848429.424526:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631405312 00000100:00100000:0.0:1787848429.424534:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631405312 00000100:00100000:0.0:1787848429.424589:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787848429.424599:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631405312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787848429.424636:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848429.424701:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631405312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848429.424708:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787848429.425447:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787848429.425464:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631405440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848429.425504:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848429.425598:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631405440 00000100:00100000:0.0:1787848429.425606:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631405440 00000100:00100000:0.0:1787848429.425691:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787848429.425699:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631405440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787848429.425727:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848429.425780:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631405440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848429.425786:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787848429.425970:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631405440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848429.426387:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631405312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787848429.616972:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848430.639958:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848430.925955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848430.926072:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611467648 00000100:00100000:2.0:1787848430.926081:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611467648 00000100:00100000:2.0:1787848430.926163:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 135 00000100:00100000:2.0:1787848430.926173:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f431e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10247:x1874694611467648:12345-192.168.201.26@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787848430.926331:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f431e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10247:x1874694611467648:12345-192.168.201.26@tcp:60:lhsmtool_posix.0 Request processed in 159us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848430.926337:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 135 00000100:00080000:1.0:1787848430.926392:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848430.948244:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848430.948572:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611467904 00000100:00100000:1.0:1787848430.948586:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611467904 00000100:00100000:1.0:1787848430.948710:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:1.0:1787848430.948721:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:10247:x1874694611467904:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787848430.949277:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:10247:x1874694611467904:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 555us (1043us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787848430.949287:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:3.0:1787848431.212781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848431.213231:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611468032 00000100:00100000:0.0:1787848431.213242:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611468032 00000100:00100000:0.0:1787848431.213338:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 136 00000100:00100000:0.0:1787848431.213349:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:11049:x1874694611468032:12345-192.168.201.26@tcp:101:lsof.0 00010000:00010000:0.0:1787848431.213371:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848431.213397:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3cb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848431.213464:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848431.213478:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848431.213492:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848431.213795:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787848431.213800:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848431.213927:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848431.213956:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3cb expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848431.213985:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3cb expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848431.213995:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:0.0:1787848431.213998:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848431.214013:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c800, rc 0) 00000100:00100000:0.0:1787848431.214377:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:11049:x1874694611468032:12345-192.168.201.26@tcp:101:lsof.0 Request processed in 1028us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848431.214386:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 136 00000100:00080000:1.0:1787848431.215686:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848431.301342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848431.301395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848431.301436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848431.301542:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611468160 00000100:00100000:0.0:1787848431.301554:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611468160 00000100:00100000:0.0:1787848431.301620:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 305 00000100:00100000:0.0:1787848431.301631:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611468160:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848431.301734:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611468160:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 105us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848431.301742:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 305 00000100:00100000:3.0:1787848431.301830:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611468288 00000100:00100000:3.0:1787848431.301835:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611468288 00000100:00100000:3.0:1787848431.301885:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611468416 00000100:00100000:3.0:1787848431.301888:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611468416 00000100:00100000:3.0:1787848431.301908:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:3.0:1787848431.301916:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611468288:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848431.301950:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611468288:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 35us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848431.301973:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:3.0:1787848431.301987:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00100000:3.0:1787848431.301995:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611468416:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848431.302034:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611468416:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 40us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848431.302040:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00080000:0.0:1787848431.302214:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787848431.302219:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787848431.663869:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787848432.570892:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1787848432.570922:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787848432.570962:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787848432.570972:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787848432.688031:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848433.712131:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848434.031993:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631405568:0@lo:400:kworker.0 00000100:00100000:2.0:1787848434.032091:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848434.032426:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631405568 00000100:00100000:3.0:1787848434.032435:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631405568 00000100:00100000:0.0:1787848434.032532:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80786940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631405696:0@lo:400:kworker.0 00000100:00100000:0.0:1787848434.032566:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848434.032672:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787848434.032686:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631405568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848434.033204:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631405696 00000100:00100000:0.0:1787848434.033210:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631405696 00000100:00100000:0.0:1787848434.033243:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787848434.033257:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f431a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631405696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848434.033296:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f431a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631405696:12345-0@lo:400:kworker.0 Request processed in 40us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848434.033303:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787848434.033345:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80786940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631405696:0@lo:400:kworker.0 00000100:00100000:3.0:1787848434.039668:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631405568:12345-0@lo:400:kworker.0 Request processed in 6972us (7564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848434.039684:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787848434.045005:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631405568:0@lo:400:kworker.0 00000100:00100000:0.0:1787848434.046033:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80787c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631406080:0@lo:400:kworker.0 00000100:00100000:0.0:1787848434.046333:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848434.046418:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80784b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631405824:0@lo:400:kworker.0 00000100:00100000:2.0:1787848434.046462:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848434.046488:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848434.046494:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631405952:0@lo:400:kworker.0 00000100:00100000:2.0:1787848434.046540:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848434.046581:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631406080 00000100:00100000:2.0:1787848434.046588:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631406080 00000100:00100000:2.0:1787848434.046656:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631405824 00000100:00100000:2.0:1787848434.046660:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631405824 00000100:00100000:2.0:1787848434.046688:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787848434.046696:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f4312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631406080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848434.046813:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631405952 00000100:00100000:3.0:1787848434.046818:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631405952 00000100:00100000:3.0:1787848434.046849:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787848434.046857:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631405952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848434.046894:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631405952:12345-0@lo:400:kworker.0 Request processed in 38us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848434.046901:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787848434.046942:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631405952:0@lo:400:kworker.0 00000100:00080000:3.0:1787848434.046986:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848434.046991:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848434.047002:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787848434.047010:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631405824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848434.047057:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631405824:12345-0@lo:400:kworker.0 Request processed in 49us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848434.047064:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787848434.047088:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80784b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631405824:0@lo:400:kworker.0 00000100:00100000:3.0:1787848434.048269:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631406208:0@lo:400:kworker.0 00000100:00100000:3.0:1787848434.048316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848434.048367:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631406208 00000100:00100000:3.0:1787848434.048373:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631406208 00000100:00100000:3.0:1787848434.048414:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787848434.048423:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631406208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848434.048464:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631406208:12345-0@lo:400:kworker.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848434.048471:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1787848434.048487:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787848434.048508:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631406208:0@lo:400:kworker.0 00000100:00100000:2.0:1787848434.050994:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f4312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631406080:12345-0@lo:400:kworker.0 Request processed in 4288us (4651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848434.051009:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787848434.068571:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80787c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631406080:0@lo:400:kworker.0 00000100:00100000:1.0:1787848434.543956:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787848434.543982:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631406336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848434.544064:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848434.544310:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631406336 00000100:00100000:2.0:1787848434.544318:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631406336 00000100:00100000:2.0:1787848434.544381:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787848434.544391:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631406336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848434.544426:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848434.544481:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631406336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848434.544488:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787848434.544569:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631406336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848434.544733:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787848434.544743:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631406464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848434.544771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848434.544863:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631406464 00000100:00100000:0.0:1787848434.544867:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631406464 00000100:00100000:0.0:1787848434.544899:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787848434.544906:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631406464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787848434.544924:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848434.544977:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631406464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848434.544984:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787848434.545135:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631406464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787848434.735874:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787848435.760351:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787848435.760358:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787848435.761152:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787848435.761162:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787848435.761910:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787848436.042335:0:12329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:33:54 (1787848434) 00000100:00100000:3.0:1787848436.420772:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848436.420819:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848436.420851:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848436.420877:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848436.420899:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848436.420970:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611469056 00000100:00100000:3.0:1787848436.420979:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611469056 00000100:00100000:3.0:1787848436.421037:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611468672 00000100:00100000:3.0:1787848436.421041:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611468672 00000100:00100000:3.0:1787848436.421064:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 178 00000100:00100000:3.0:1787848436.421074:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2353:x1874694611469056:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848436.421144:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2353:x1874694611469056:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848436.421167:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 178 00000100:00100000:3.0:1787848436.421182:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 179 00000100:00100000:3.0:1787848436.421189:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:2353:x1874694611468672:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848436.421218:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:2353:x1874694611468672:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 30us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848436.421567:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611468800 00000100:00100000:1.0:1787848436.421572:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611468800 00000100:00100000:1.0:1787848436.421612:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611468928 00000100:00100000:1.0:1787848436.421615:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611468928 00000100:00100000:1.0:1787848436.421637:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00100000:1.0:1787848436.421667:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611468800:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848436.421695:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611468800:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 30us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848436.421701:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00100000:1.0:1787848436.421713:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00100000:1.0:1787848436.421718:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611468928:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848436.421738:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611468928:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 20us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848436.421752:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00080000:1.0:1787848436.421786:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848436.421790:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787848436.421792:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848436.421932:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611468544 00000100:00100000:2.0:1787848436.421937:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611468544 00000100:00100000:2.0:1787848436.421974:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 307 00000100:00100000:2.0:1787848436.421982:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2353:x1874694611468544:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848436.422007:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2353:x1874694611468544:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 27us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848436.422020:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 307 00000100:00100000:3.0:1787848436.422659:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 179 00010000:00010000:2.0:1787848436.785132:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848437.808008:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848437.908705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848437.908893:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611469312 00000100:00100000:2.0:1787848437.908905:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611469312 00000100:00100000:2.0:1787848437.908981:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 137 00000100:00100000:2.0:1787848437.908991:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:11314:x1874694611469312:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848437.909016:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848437.909040:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe49 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909116:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe50 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909131:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909143:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909158:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbe57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909165:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbe57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909172:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbe57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909622:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbe5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909687:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbe5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909694:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbe5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848437.909705:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787848437.909924:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909932:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe50 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909939:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909945:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848437.909950:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909958:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909973:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ff53a89b00) 00010000:00010000:2.0:1787848437.909976:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848437.909981:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.909988:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbe50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.910000:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbe57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.910011:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbe57 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.910016:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbe57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.910021:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848437.910024:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbe57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.910029:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbe57 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.910036:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93ff53a89900) 00010000:00010000:2.0:1787848437.910039:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848437.910042:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbe57 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.910048:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbe57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.910416:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe49 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3d2 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.910430:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbe5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3d2 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848437.910437:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:2.0:1787848437.910439:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848437.910449:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664000, rc 0) 00000100:00100000:2.0:1787848437.910528:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:11314:x1874694611469312:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 1537us (1835us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787848437.910537:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 137 00000100:00100000:2.0:1787848437.917353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848437.917401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848437.917486:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611469440 00000100:00100000:1.0:1787848437.917496:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611469440 00000100:00100000:1.0:1787848437.917566:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:1.0:1787848437.917578:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f9ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:2351:x1874694611469440:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848437.917594:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848437.917620:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbe5e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3d2 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848437.917683:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:1.0:1787848437.917688:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848437.917752:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f9ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:2351:x1874694611469440:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 177us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848437.917760:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:3.0:1787848437.918211:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611469568 00000100:00100000:3.0:1787848437.918217:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611469568 00000100:00100000:3.0:1787848437.918253:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 138 00000100:00100000:3.0:1787848437.918260:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:11314:x1874694611469568:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787848437.918335:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:11314:x1874694611469568:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 Request processed in 76us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848437.918342:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 138 00000040:00080000:3.0:1787848438.831851:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787848438.831863:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787848438.832417:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787848438.832428:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787848438.833308:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848439.151815:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631406592:0@lo:400:kworker.0 00000100:00100000:2.0:1787848439.151988:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848439.152141:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787848439.152148:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631406720:0@lo:400:kworker.0 00000100:00100000:1.0:1787848439.152229:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631406592 00000100:00100000:1.0:1787848439.152236:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631406592 00000100:00100000:1.0:1787848439.152275:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787848439.152283:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631406592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848439.152330:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631406592:12345-0@lo:400:kworker.0 Request processed in 48us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848439.152337:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787848439.152406:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848439.152443:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631406592:0@lo:400:kworker.0 00000100:00100000:1.0:1787848439.152500:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631406720 00000100:00100000:1.0:1787848439.152503:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631406720 00000100:00100000:1.0:1787848439.152538:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787848439.152544:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631406720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848439.152586:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631406720:12345-0@lo:400:kworker.0 Request processed in 43us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848439.152593:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787848439.152685:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631406720:0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.154105:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff790ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631407232:0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.155142:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848439.155208:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787848439.155217:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631407104:0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.155260:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848439.155293:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631406848:0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.155318:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848439.155340:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848439.155346:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631406976:0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.155370:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848439.155405:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631407104 00000100:00100000:3.0:1787848439.155413:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631407104 00000100:00100000:3.0:1787848439.155468:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631406848 00000100:00100000:3.0:1787848439.155471:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631406848 00000100:00100000:3.0:1787848439.155496:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787848439.155505:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79299680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631407104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.155558:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79299680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631407104:12345-0@lo:400:kworker.0 Request processed in 54us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848439.155566:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787848439.155581:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787848439.155587:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631406848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.155617:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631406848:12345-0@lo:400:kworker.0 Request processed in 30us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848439.155622:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787848439.155671:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631407232 00000100:00100000:3.0:1787848439.155675:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631407232 00000100:00100000:3.0:1787848439.155711:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631406976 00000100:00100000:3.0:1787848439.155715:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631406976 00000100:00100000:3.0:1787848439.155734:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787848439.155741:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631407232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.155771:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631407232:12345-0@lo:400:kworker.0 Request processed in 31us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848439.155777:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787848439.155788:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787848439.155793:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79298f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631406976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.155819:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79298f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631406976:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848439.155825:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1787848439.155841:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848439.155845:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848439.155848:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848439.155896:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631406976:0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.155906:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631406848:0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.156767:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631407104:0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.156779:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff790ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631407232:0@lo:400:kworker.0 00000100:00100000:3.0:1787848439.671512:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631407360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848439.671613:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848439.672121:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631407360 00000100:00100000:2.0:1787848439.672130:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631407360 00000100:00100000:2.0:1787848439.672197:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787848439.672207:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7929b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631407360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848439.672245:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848439.672297:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7929b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631407360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848439.672305:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787848439.672350:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631407360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787848439.679433:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848439.679457:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631407488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848439.679524:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848439.679587:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631407488 00000100:00100000:2.0:1787848439.679593:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631407488 00000100:00100000:2.0:1787848439.679666:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787848439.679675:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631407488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848439.679708:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848439.679758:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631407488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848439.679765:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787848439.679808:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631407488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787848439.855838:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848440.185295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848440.185389:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611469696 00000100:00100000:0.0:1787848440.185400:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611469696 00000100:00100000:0.0:1787848440.186731:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 139 00000100:00100000:0.0:1787848440.186747:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:11358:x1874694611469696:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848440.186776:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848440.186795:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbe6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.186871:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.186885:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.186908:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.186925:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.186932:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.186939:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187252:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187260:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187267:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187273:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848440.187284:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187292:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187307:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:0.0:1787848440.187311:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848440.187315:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187322:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187334:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187340:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187345:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187350:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148d400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848440.187353:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187359:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187366:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93ff48373900) 00010000:00010000:0.0:1787848440.187369:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848440.187378:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187384:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187420:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbe6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3d9 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187431:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:0.0:1787848440.187434:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848440.187438:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbe6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3d9 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.187447:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c600, rc 0) 00000100:00100000:0.0:1787848440.187523:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:11358:x1874694611469696:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 781us (2238us total) trans 0 rc 301/301 00000100:00100000:0.0:1787848440.187531:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 139 00000100:00080000:1.0:1787848440.191837:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848440.202955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848440.203040:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611469952 00000100:00100000:2.0:1787848440.203052:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611469952 00000100:00100000:2.0:1787848440.203113:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 140 00000100:00100000:2.0:1787848440.203124:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:11358:x1874694611469952:12345-192.168.201.26@tcp:36:lfs.0 00010000:00010000:2.0:1787848440.203200:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848440.203226:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cb7ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb212 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848440.203245:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:2.0:1787848440.203251:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848440.203542:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848440.203557:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3cb expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848440.203567:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848440.203601:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3cb expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848440.203621:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3cb expref: 5 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848440.203636:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78fab0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631407616:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848440.203752:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6ecee0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848440.207122:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848440.207754:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78fab0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631407616:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848440.207781:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848440.210467:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611470080 00000100:00100000:0.0:1787848440.210480:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611470080 00010000:00010000:0.0:1787848440.210541:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3cb expref: 6 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848440.210577:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:0.0:1787848440.210585:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2351:x1874694611470080:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848440.210599:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848440.210607:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3cb expref: 6 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.210631:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3cb expref: 6 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.210678:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbe42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3cb expref: 6 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.210691:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:0.0:1787848440.210696:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.210704:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.210712:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.210735:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848440.210787:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611470080:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 202us (3675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848440.210794:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 59 00010000:00010000:0.0:1787848440.210919:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.210927:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.210947:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe88 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.210964:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.210972:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787848440.212019:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787848440.222131:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787848440.222341:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.222352:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.222360:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.222366:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848440.222371:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.222379:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.222397:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:0.0:1787848440.222400:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848440.222405:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.222412:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbe81 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787848440.222447:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d92056a reply state 000000006d49a2f0 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848440.222456:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787848440.222614:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:11358:x1874694611469952:12345-192.168.201.26@tcp:36:lfs.0 Request processed in 19488us (19666us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787848440.222624:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 140 00010000:00010000:1.0:1787848440.227939:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.227957:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe88 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.227964:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.227970:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148d400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848440.227975:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.227984:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe88 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.228001:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93ff48373900) 00010000:00010000:1.0:1787848440.228004:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848440.228008:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe88 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.228014:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbe88 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848440.386935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848440.387004:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611470208 00000100:00100000:2.0:1787848440.387015:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611470208 00000100:00100000:0.0:1787848440.387134:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 141 00000100:00100000:0.0:1787848440.387160:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:11366:x1874694611470208:12345-192.168.201.26@tcp:101:lctl.0 00010000:00010000:0.0:1787848440.387196:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848440.387226:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.387318:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.387337:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.387350:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848440.387437:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787848440.387441:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848440.387470:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.387496:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbe8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3e0 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.387533:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3e0 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.387542:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:0.0:1787848440.387545:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848440.387549:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148da00, rc 0) 00000100:00100000:0.0:1787848440.387622:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:11366:x1874694611470208:12345-192.168.201.26@tcp:101:lctl.0 Request processed in 478us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848440.387630:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 141 00000100:00100000:3.0:1787848440.474902:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848440.485125:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611470336 00000100:00100000:1.0:1787848440.485146:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611470336 00000100:00100000:1.0:1787848440.485236:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 142 00000100:00100000:1.0:1787848440.485248:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+15:11372:x1874694611470336:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787848440.485272:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848440.485296:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbe9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3e7 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.485369:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbea4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.485384:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.485396:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.485410:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbeab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.485417:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbeab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.485424:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbeab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.485536:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbeb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.485545:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.485568:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848440.485605:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787848440.485609:0:7097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848440.485988:0:7097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486003:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486010:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbea4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486017:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbea4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486023:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848440.486027:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbea4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486034:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbea4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486049:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:1.0:1787848440.486052:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848440.486056:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486062:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486101:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbeab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486108:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbeab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486114:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbeab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486120:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ee00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848440.486123:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbeab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486129:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbeab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486137:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93ff43951d00) 00010000:00010000:1.0:1787848440.486140:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848440.486143:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbeab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486150:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cbeab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486189:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbe9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3e7 expref: 17 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486203:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbeb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3e7 expref: 16 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.486221:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:1.0:1787848440.486223:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787848440.486226:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e600, rc 0) 00000100:00100000:1.0:1787848440.486311:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:11372:x1874694611470336:12345-192.168.201.26@tcp:101:bash.0 Request processed in 1066us (11426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848440.486320:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 142 00000100:00100000:3.0:1787848440.490226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848440.490689:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611470592 00000100:00100000:0.0:1787848440.490699:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611470592 00000100:00100000:0.0:1787848440.490777:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 143 00000100:00100000:0.0:1787848440.490787:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:11372:x1874694611470592:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787848440.490809:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848440.490829:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbeb9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.490983:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbec0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.490999:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbec0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.491011:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbec0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.491080:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbec7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.491107:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbec7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.491115:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbec7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787848440.491927:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787848440.492202:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbece lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.492213:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.492222:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.492259:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbec0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.492266:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbec0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.492272:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbec0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.492279:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848440.492283:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbec0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.492291:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbec0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.492326:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:0.0:1787848440.492329:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848440.492336:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbec0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.492343:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbec0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787848440.492357:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004017e5d8 reply state 00000000281fdba0 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbec7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848440.492367:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787848440.492401:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbeb9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3ee expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.492416:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3ee expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.492423:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848440.492425:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848440.492428:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c600, rc 0) 00000100:00100000:0.0:1787848440.492561:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:11372:x1874694611470592:12345-192.168.201.26@tcp:101:bash.0 Request processed in 1775us (2343us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787848440.492570:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 143 00010000:00010000:3.0:1787848440.496310:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbec7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.496335:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbec7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.496342:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbec7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.496349:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148d400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848440.496355:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbec7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.496363:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbec7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.496384:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff48373f00) 00010000:00010000:3.0:1787848440.496387:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848440.496392:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbec7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.496398:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cbec7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848440.498868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848440.499002:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611470720 00000100:00100000:1.0:1787848440.499013:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611470720 00000100:00100000:1.0:1787848440.499086:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:1.0:1787848440.499109:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2351:x1874694611470720:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787848440.499128:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848440.499148:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cbedc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3f5 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787848440.499178:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848440.499198:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:1.0:1787848440.499204:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848440.499213:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cbedc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3f5 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.499234:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cbedc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3f5 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.499249:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42fa00, rc 0) 00000100:00100000:1.0:1787848440.499323:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611470720:12345-192.168.201.26@tcp:101:bash.0 Request processed in 229us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848440.499347:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00080000:2.0:1787848440.499526:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787848440.506876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848440.507040:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611470848 00000100:00100000:1.0:1787848440.507052:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611470848 00000100:00100000:1.0:1787848440.507127:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:1.0:1787848440.507139:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f430780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:11372:x1874694611470848:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787848440.507161:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848440.507180:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb3fc expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.507213:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cbedc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3f5 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.507222:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848440.507227:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848440.507232:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.507266:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cbedc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3f5 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.507280:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cbedc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3f5 expref: 7 pid: 6689 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848440.507295:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80784f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1874694631407744:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787848440.507394:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f4d80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848440.510396:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80784f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1874694631407744:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787848440.510441:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.510463:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42ee00, rc 0) 00000100:00100000:1.0:1787848440.510525:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f430780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:11372:x1874694611470848:12345-192.168.201.26@tcp:101:bash.0 Request processed in 3388us (3658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848440.510535:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:3.0:1787848440.511974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848440.512315:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611470976 00000100:00100000:1.0:1787848440.512323:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611470976 00010000:00010000:1.0:1787848440.512365:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cbedc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3f5 expref: 7 pid: 6689 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848440.512411:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:1.0:1787848440.512421:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611470976:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848440.512436:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848440.512460:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cbedc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3f5 expref: 7 pid: 6689 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.512475:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cbedc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3f5 expref: 7 pid: 6689 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.512498:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cbedc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3f5 expref: 7 pid: 6689 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.512515:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848440.512526:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848440.512535:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.512546:0:8522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.512598:0:8522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848440.512612:0:8522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80784f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8522:1874694631407872:192.168.201.26@tcp:105: 00000100:00100000:1.0:1787848440.512996:0:8522:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f4d80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848440.520189:0:8522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80784f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8522:1874694631407872:192.168.201.26@tcp:105: 00010000:00010000:1.0:1787848440.520230:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848440.520309:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611470976:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 7889us (8341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848440.520326:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:0.0:1787848440.530347:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848440.530937:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611471232 00000100:00100000:1.0:1787848440.530948:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611471232 00000100:00100000:1.0:1787848440.531055:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:1.0:1787848440.531066:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f430b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:11372:x1874694611471232:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:1.0:1787848440.531495:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f430b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:11372:x1874694611471232:12345-192.168.201.26@tcp:35:bash.0 Request processed in 431us (1156us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787848440.531504:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:3.0:1787848440.689730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848440.689901:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611471488 00000100:00100000:2.0:1787848440.689911:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611471488 00000100:00100000:2.0:1787848440.689979:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 144 00000100:00100000:2.0:1787848440.689991:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:11382:x1874694611471488:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848440.690020:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848440.690041:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbeea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb403 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848440.690162:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787848440.690547:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbeea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb403 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848440.690563:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:2.0:1787848440.690567:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787848440.690587:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbeea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb403 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848440.690602:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664a00, rc 0) 00000100:00100000:2.0:1787848440.690758:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:11382:x1874694611471488:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 769us (1038us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787848440.690765:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 144 00000100:00100000:2.0:1787848440.700938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848440.701032:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611471744 00000100:00100000:1.0:1787848440.701043:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611471744 00000100:00100000:1.0:1787848440.701123:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:1.0:1787848440.701144:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:11382:x1874694611471744:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848440.701479:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:11382:x1874694611471744:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 336us (552us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787848440.701487:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:3.0:1787848440.867895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848440.868076:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611471872 00000100:00100000:1.0:1787848440.868086:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611471872 00000100:00100000:1.0:1787848440.868167:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 145 00000100:00100000:1.0:1787848440.868451:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:11388:x1874694611471872:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848440.868481:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848440.868501:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbef8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb40a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.868571:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbeff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.868587:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbeff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.868600:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbeff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848440.868714:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787848440.868719:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848440.868745:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbeff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.868774:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cbef8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb40a expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.868822:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbeff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb40a expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.868830:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:1.0:1787848440.868846:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787848440.868850:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f400, rc 0) 00000100:00100000:1.0:1787848440.868924:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:11388:x1874694611471872:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 748us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848440.868933:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 145 00000100:00100000:3.0:1787848440.879279:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848440.879466:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611472128 00000100:00100000:0.0:1787848440.879477:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611472128 00000100:00100000:0.0:1787848440.879563:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 146 00000100:00100000:0.0:1787848440.879571:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:11388:x1874694611472128:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848440.879591:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848440.879619:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbf06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb411 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.879792:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbf0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.879808:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbf0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.879822:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbf0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848440.879845:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787848440.879994:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cbf06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb411 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.880015:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbf0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb411 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.880035:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848440.880038:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848440.880049:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c000, rc 0) 00000100:00100000:0.0:1787848440.880117:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:11388:x1874694611472128:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 545us (853us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787848440.880124:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 146 00010000:00010000:2.0:1787848440.880618:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848440.886577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848440.886620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848440.886788:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611472512 00000100:00100000:3.0:1787848440.886800:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611472512 00000100:00100000:3.0:1787848440.886895:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 147 00000100:00100000:3.0:1787848440.886906:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:11388:x1874694611472512:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848440.886937:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848440.886962:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cbf1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb418 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.887077:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbf22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.887093:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbf22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.887106:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbf22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848440.887122:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:0.0:1787848440.887469:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611472256 00000100:00100000:0.0:1787848440.887490:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611472256 00010000:00010000:3.0:1787848440.887713:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cbf1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb418 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.887733:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbf22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb418 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.887742:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff48373400) 00010000:00010000:3.0:1787848440.887745:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787848440.887749:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237000, rc 0) 00000100:00100000:3.0:1787848440.887829:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:11388:x1874694611472512:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 923us (1206us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787848440.887845:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 147 00000100:00100000:0.0:1787848440.887933:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787848440.887943:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78faa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:2352:x1874694611472256:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848440.887958:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848440.887974:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cbf0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb411 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.887985:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848440.887989:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848440.888008:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78faa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+25:2352:x1874694611472256:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 69us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848440.888015:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:3.0:1787848440.897530:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848440.898188:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611472640 00000100:00100000:0.0:1787848440.898202:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611472640 00000100:00100000:0.0:1787848440.898284:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:0.0:1787848440.898297:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611472640:12345-192.168.201.26@tcp:1:lfs.0 00010000:00010000:0.0:1787848440.898362:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.898384:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.898395:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848440.898400:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848440.898406:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.898459:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.898475:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 6 pid: 6691 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848440.898494:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f4330c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874694631408000:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848440.898604:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff44f929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848440.907493:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f4330c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874694631408000:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848440.907534:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848440.907844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848440.907940:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611472768 00000100:00100000:0.0:1787848440.907948:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611472768 00002000:00100000:0.0:1787848440.908010:0:6695:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93ff80784f00 x1874694611472768/t0(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:146/0 lens 504/0 e 0 to 0 dl 1787848451 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787848440.908021:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff80784f00 with x1874694611472768 ext(0->12) 00010000:00010000:0.0:1787848440.908029:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 7 pid: 6691 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.908055:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 7 pid: 6691 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787848440.908064:0:6695:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ff80784f00 00000100:00100000:0.0:1787848440.908114:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:0.0:1787848440.908136:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80784f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611472768:12345-192.168.201.26@tcp:4:lfs.0 00000100:00100000:0.0:1787848440.908818:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80784f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2351:x1874694611472768:12345-192.168.201.26@tcp:4:lfs.0 Request processed in 690us (981us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787848440.908829:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00002000:00100000:0.0:1787848440.908846:0:6695:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93ff80784f00 x1874694611472768/t4294967305(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:146/0 lens 504/448 e 0 to 0 dl 1787848451 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787848440.908856:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff80784f00 with x1874694611472768 ext(0->12) 00010000:00010000:0.0:1787848440.908864:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 9 pid: 6691 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.908878:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 9 pid: 6691 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787848440.908885:0:6695:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ff80784f00 00000100:00100000:2.0:1787848440.914342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848440.914509:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611472896 00000100:00100000:0.0:1787848440.914521:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611472896 00010000:00010000:0.0:1787848440.914565:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 9 pid: 6691 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848440.914685:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:0.0:1787848440.914696:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2352:x1874694611472896:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848440.914714:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787848440.914734:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787848440.914737:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787848441 00002000:00010000:0.0:1787848440.914753:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787848441 00002000:00010000:0.0:1787848440.914756:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787848441 00010000:00010000:0.0:1787848440.914764:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 9 pid: 6691 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.914781:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 9 pid: 6691 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.914808:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000052b7f76/0x9aeb41e0543cbee3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3fc expref: 9 pid: 6691 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.914830:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848440.914845:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848440.914853:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.914864:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848440.914902:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848440.914974:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611472896:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 280us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848440.914981:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 61 00010000:00010000:3.0:1787848440.915060:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.915070:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.915101:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.915110:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.915118:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.915136:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c800 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848440.915148:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.915158:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.915172:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.915189:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cbf30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848440.915257:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611472640:12345-192.168.201.26@tcp:1:lfs.0 Request processed in 16963us (17742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848440.915265:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:1.0:1787848440.919422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848440.919516:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611473152 00000100:00100000:2.0:1787848440.919526:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611473152 00000100:00100000:2.0:1787848440.919581:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:2.0:1787848440.919590:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff47b4dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+25:11388:x1874694611473152:12345-192.168.201.26@tcp:35:lfs.0 00000004:00010000:2.0:1787848440.919685:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbf22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb418 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787848440.919965:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787848440.920001:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787848440.920821:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787848440.920905:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848440.920923:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbece lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3ee expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848440.920931:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848440.920976:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3ee expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848440.920992:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbece lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3ee expref: 29 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848440.921007:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78fabc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1874694631408128:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848440.921398:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6eceec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787848440.926043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848440.926296:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78fabc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1874694631408128:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787848440.926329:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848440.926376:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611473280 00000100:00100000:3.0:1787848440.926381:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611473280 00010000:00010000:3.0:1787848440.926471:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbece lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3ee expref: 30 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848440.926501:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:3.0:1787848440.926508:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:2351:x1874694611473280:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848440.926522:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848440.926530:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbece lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3ee expref: 30 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.926542:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3ee expref: 30 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.926565:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cbece lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3ee expref: 30 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.926581:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff48373400) 00010000:00010000:3.0:1787848440.926586:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.926595:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.926621:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848440.926732:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848440.926793:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:2351:x1874694611473280:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 283us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848440.926803:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 62 00010000:00010000:1.0:1787848440.928622:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.928735:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787848440.928894:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787848440.929368:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787848440.929617:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80785680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874694631408256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787848440.929812:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848440.929917:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f4d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787848440.929964:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631408256 00000100:00100000:2.0:1787848440.929973:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631408256 00000100:00100000:2.0:1787848440.930135:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787848440.930153:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1874694631408256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787848440.930253:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1874694631408256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848440.930260:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787848440.930328:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80785680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874694631408256:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787848440.930860:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787848440.930930:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80785680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874694631408384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787848440.930969:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848440.932341:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff4562cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787848440.932737:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631408384 00000100:00100000:0.0:1787848440.932747:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631408384 00000100:00100000:0.0:1787848440.932800:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787848440.932811:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80787840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874694631408384:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787848440.933396:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80787840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1874694631408384:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 586us (2425us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787848440.933406:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787848440.933580:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80785680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874694631408384:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787848440.933731:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787848440.933791:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.933802:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.933810:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.933817:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848440.933822:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.933829:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.933858:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff48373400) 00010000:00010000:1.0:1787848440.933861:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787848440.933867:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.933875:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf37 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787848440.934363:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787848440.934522:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787848440.934534:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389845894197ns, next at 390845891923ns, rc = 0 00000001:00080000:1.0:1787848440.934542:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787848440.934580:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff48373400) 00010000:00010000:1.0:1787848440.934584:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787848440.934594:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cbf22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb418 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848440.934901:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff47b4dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:11388:x1874694611473152:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 15310us (15488us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787848440.934910:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 38 00000020:00080000:1.0:1787848440.934915:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787848440.940496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848440.940811:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611473408 00000100:00100000:1.0:1787848440.940822:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611473408 00000100:00100000:1.0:1787848440.940942:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 148 00000100:00100000:1.0:1787848440.940954:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:11388:x1874694611473408:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848440.940982:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848440.941010:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cbf3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb41f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.941087:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cbf3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb41f expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.941102:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cbf3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb41f expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848440.941131:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848440.941134:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787848440.941160:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42ea00, rc 0) 00000100:00100000:1.0:1787848440.941455:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+33:11388:x1874694611473408:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 500us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848440.941463:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 148 00000100:00100000:0.0:1787848440.945455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848440.945560:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611473664 00000100:00100000:1.0:1787848440.945573:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611473664 00000100:00100000:1.0:1787848440.945680:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:1.0:1787848440.945691:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f4330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+33:11388:x1874694611473664:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848440.945973:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f4330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:11388:x1874694611473664:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 283us (527us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787848440.945981:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:2.0:1787848441.102473:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848441.102685:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611473920 00000100:00100000:1.0:1787848441.102696:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611473920 00000100:00100000:1.0:1787848441.102760:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 149 00000100:00100000:1.0:1787848441.102771:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:11398:x1874694611473920:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848441.102796:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848441.102816:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbf45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb426 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848441.102949:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787848441.103068:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbf45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb426 expref: 36 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.103083:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:1.0:1787848441.103086:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787848441.103091:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbf45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb426 expref: 36 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.103126:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f600, rc 0) 00000100:00100000:1.0:1787848441.103199:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:11398:x1874694611473920:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 430us (736us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787848441.103207:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 149 00000100:00100000:3.0:1787848441.112309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848441.112434:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611474048 00000100:00100000:2.0:1787848441.112446:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611474048 00000100:00100000:2.0:1787848441.112507:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 150 00000100:00100000:2.0:1787848441.112516:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:11398:x1874694611474048:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:2.0:1787848441.112598:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112614:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112678:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112697:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbf5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112705:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbf5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112711:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbf5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112817:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbf61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112826:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbf61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112843:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbf61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787848441.112887:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbf61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112903:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112909:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112916:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112933:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848441.112937:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112946:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112959:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:2.0:1787848441.112961:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848441.112966:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112972:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbf53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112984:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbf5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112989:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbf5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112995:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbf5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.112999:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848441.113002:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbf5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.113007:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbf5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.113025:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff53a89900) 00010000:00010000:2.0:1787848441.113028:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848441.113031:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbf5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.113036:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cbf5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.113050:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbf61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.113056:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbf61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.113062:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbf61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.113066:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848441.113069:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbf61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.113075:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbf61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.113081:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:2.0:1787848441.113083:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848441.113086:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbf61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.113091:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cbf61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848441.113183:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:11398:x1874694611474048:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 666us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848441.113191:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 150 00000100:00100000:0.0:1787848441.116237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848441.116341:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611474304 00000100:00100000:1.0:1787848441.116351:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611474304 00000100:00100000:1.0:1787848441.116425:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:1.0:1787848441.116436:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f432940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:11398:x1874694611474304:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848441.116759:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f432940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+36:11398:x1874694611474304:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 325us (532us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787848441.116767:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:3.0:1787848441.172616:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848441.172753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611474560 00000100:00100000:1.0:1787848441.172765:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611474560 00000100:00100000:1.0:1787848441.172849:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 151 00000100:00100000:1.0:1787848441.172860:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+36:11401:x1874694611474560:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848441.172887:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848441.172912:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbf68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb42d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.172991:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbf6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173006:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbf6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173018:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbf6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173050:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbf76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173057:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbf76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173064:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbf76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173219:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbf7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173294:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbf7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173303:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbf7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848441.173313:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787848441.173621:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbf6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173629:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbf6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173635:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbf6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173788:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848441.173793:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbf6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173812:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbf6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173825:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:1.0:1787848441.173837:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848441.173842:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbf6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173848:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbf6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173862:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbf76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173869:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbf76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173875:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbf76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173880:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42fc00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848441.173883:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbf76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173891:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbf76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173897:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff43951300) 00010000:00010000:1.0:1787848441.173900:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848441.173902:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbf76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173917:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbf76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173966:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbf68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb42d expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173978:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbf7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb42d expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.173985:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848441.173986:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787848441.173989:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e000, rc 0) 00000100:00100000:1.0:1787848441.174106:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:11401:x1874694611474560:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1247us (1499us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787848441.174114:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 151 00000100:00100000:2.0:1787848441.181727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848441.181864:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611474688 00000100:00100000:1.0:1787848441.181873:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611474688 00000100:00100000:1.0:1787848441.181929:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 152 00000100:00100000:1.0:1787848441.181940:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:11401:x1874694611474688:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:1.0:1787848441.182006:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbf8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.182019:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.182027:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.182066:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.182070:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbf8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.182075:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbf8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.182079:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42fe00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848441.182082:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbf8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.182086:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbf8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.182096:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848441.182098:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787848441.182101:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbf8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.182104:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fe00/0x9aeb41e0543cbf8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848441.182374:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:11401:x1874694611474688:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 434us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848441.182382:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 152 00000100:00100000:2.0:1787848441.190128:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848441.190212:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611474944 00000100:00100000:1.0:1787848441.190223:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611474944 00000100:00100000:1.0:1787848441.190298:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:1.0:1787848441.190325:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:11401:x1874694611474944:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848441.190590:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+39:11401:x1874694611474944:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 267us (472us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787848441.190599:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:0.0:1787848441.541075:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848441.541128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848441.541189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848441.541568:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611475328 00000100:00100000:1.0:1787848441.541579:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611475328 00000100:00100000:1.0:1787848441.541676:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 183 00000100:00100000:1.0:1787848441.541688:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f430b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611475328:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848441.541774:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f430b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611475328:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 89us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848441.541782:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 183 00000100:00100000:3.0:1787848441.542055:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611475200 00000100:00100000:3.0:1787848441.542061:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611475200 00000100:00100000:3.0:1787848441.542186:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 107 00000100:00100000:3.0:1787848441.542196:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2354:x1874694611475200:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848441.542246:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2354:x1874694611475200:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 52us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848441.542253:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 107 00000100:00100000:2.0:1787848441.543595:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611475072 00000100:00100000:2.0:1787848441.543605:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611475072 00000100:00100000:2.0:1787848441.543694:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 309 00000100:00100000:2.0:1787848441.543705:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611475072:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848441.543782:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611475072:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 79us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848441.543789:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 309 00000100:00080000:1.0:1787848441.543882:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787848441.676068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848441.676279:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611475584 00000100:00100000:3.0:1787848441.676290:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611475584 00000100:00100000:3.0:1787848441.676358:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 153 00000100:00100000:3.0:1787848441.676381:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80784780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+39:11432:x1874694611475584:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:3.0:1787848441.676412:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848441.676435:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cbf92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb434 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848441.676543:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cbf99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848441.676589:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cbf99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848441.676602:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cbf99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848441.676615:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787848441.676779:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cbf92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb434 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848441.676800:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cbf99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb434 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848441.676809:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:3.0:1787848441.676812:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848441.676815:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237a00, rc 0) 00000100:00100000:3.0:1787848441.676893:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80784780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+41:11432:x1874694611475584:12345-192.168.201.26@tcp:101:cat.0 Request processed in 525us (835us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787848441.676899:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 153 00000100:00100000:0.0:1787848441.681351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848441.681762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848441.682003:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611475968 00000100:00100000:3.0:1787848441.682014:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611475968 00000100:00100000:3.0:1787848441.682079:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:3.0:1787848441.682089:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+41:11432:x1874694611475968:12345-192.168.201.26@tcp:35:cat.0 00000100:00100000:3.0:1787848441.683292:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+42:11432:x1874694611475968:12345-192.168.201.26@tcp:35:cat.0 Request processed in 1199us (1525us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787848441.683304:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:1.0:1787848441.683402:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611475712 00000100:00100000:1.0:1787848441.683408:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611475712 00000100:00100000:1.0:1787848441.683465:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:1.0:1787848441.683477:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+42:2353:x1874694611475712:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848441.683491:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848441.683521:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cbf99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb434 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.683541:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848441.683547:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848441.684105:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+41:2353:x1874694611475712:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 628us (2764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848441.684114:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787848441.831405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848441.831489:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611476224 00000100:00100000:1.0:1787848441.831499:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611476224 00000100:00100000:1.0:1787848441.831576:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 154 00000100:00100000:1.0:1787848441.831587:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+41:11438:x1874694611476224:12345-192.168.201.26@tcp:101:dd.0 00010000:00010000:1.0:1787848441.831611:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848441.831614:0:9224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787848441.831665:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbeff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb40a expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.831687:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:1.0:1787848441.831692:0:9224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787848441.831705:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbfa7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb43b expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.831790:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.831814:0:9224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbf7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb42d expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.831831:0:9224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.832049:0:9224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbf7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb42d expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.832064:0:9224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbf7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb42d expref: 41 pid: 5844 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848441.832103:0:9224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80786580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631408512:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787848441.832237:0:9224:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff4562c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787848441.836625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848441.836782:0:9224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80786580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631408512:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787848441.836812:0:9224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848441.837168:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611476352 00000100:00100000:3.0:1787848441.837191:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611476352 00010000:00010000:3.0:1787848441.837230:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbf7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb42d expref: 42 pid: 5844 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848441.837269:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:3.0:1787848441.837280:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f9fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+42:2351:x1874694611476352:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848441.837296:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848441.837303:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbf7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb42d expref: 42 pid: 5844 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848441.837316:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbf7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb42d expref: 42 pid: 5844 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848441.837339:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cbf7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb42d expref: 42 pid: 5844 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848441.837356:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:3.0:1787848441.837361:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848441.837370:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848441.837378:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848441.837442:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848441.837499:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f9fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+41:2351:x1874694611476352:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 220us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848441.837516:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 63 00010000:00010000:1.0:1787848441.845067:0:9224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.845315:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848441.845338:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787848441.845531:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cbfa7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb43b expref: 42 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.845552:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb43b expref: 41 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.846261:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848441.846265:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787848441.846269:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42fc00, rc 0) 00000100:00100000:1.0:1787848441.846408:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+41:11438:x1874694611476224:12345-192.168.201.26@tcp:101:dd.0 Request processed in 14820us (15010us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787848441.846417:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 154 00000100:00100000:0.0:1787848441.865613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848441.870679:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611476608 00000100:00100000:2.0:1787848441.870695:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611476608 00000100:00100000:2.0:1787848441.870777:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 155 00000100:00100000:2.0:1787848441.870788:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+41:11438:x1874694611476608:12345-192.168.201.26@tcp:36:dd.0 00010000:00010000:2.0:1787848441.872468:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.872494:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848441.872506:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787848441.872581:0:7097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787848441.872606:0:7097:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084c8133e reply state 000000005c7df71b transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848441.872614:0:7097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787848441.873187:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+44:11438:x1874694611476608:12345-192.168.201.26@tcp:36:dd.0 Request processed in 2395us (7579us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787848441.873196:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 155 00000020:00080000:2.0:1787848441.873202:0:7097:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787848441.889940:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.889975:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.889991:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.889997:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848441.890001:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.890008:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.890026:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848441.890029:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848441.890035:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848441.890041:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848441.903845:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848442.421042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848442.421233:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611476736 00000100:00100000:2.0:1787848442.421245:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611476736 00000100:00100000:2.0:1787848442.421334:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 156 00000100:00100000:2.0:1787848442.421346:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+43:11452:x1874694611476736:12345-192.168.201.26@tcp:101:stat.0 00010000:00010000:2.0:1787848442.421374:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848442.421395:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbfc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb442 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.421486:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbfca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.421501:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbfca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.421523:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbfca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.421540:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.421564:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.421570:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.421731:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.421742:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb43b expref: 44 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.421750:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.421781:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb43b expref: 44 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.421794:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb43b expref: 44 pid: 9224 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848442.421817:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78faa580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631408640:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848442.421925:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6ecee240 going to sleep for 11 seconds 00000100:00080000:1.0:1787848442.422054:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848442.437830:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848442.438360:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611476992 00000100:00100000:0.0:1787848442.438371:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611476992 00000100:00100000:0.0:1787848442.438434:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:0.0:1787848442.438444:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+45:5594:x1874694611476992:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787848442.438852:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+46:5594:x1874694611476992:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 408us (1042us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787848442.438861:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:3.0:1787848442.440138:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78faa580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631408640:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848442.440166:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848442.447370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848442.447487:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611477120 00000100:00100000:2.0:1787848442.447498:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611477120 00010000:00010000:2.0:1787848442.447557:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb43b expref: 46 pid: 9224 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848442.447712:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:2.0:1787848442.447724:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+46:2351:x1874694611477120:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848442.447740:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848442.447747:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb43b expref: 46 pid: 9224 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.447761:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb43b expref: 46 pid: 9224 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.447785:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cbfae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb43b expref: 46 pid: 9224 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.447803:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:2.0:1787848442.447824:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.447835:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.447843:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.447876:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848442.447935:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+45:2351:x1874694611477120:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 214us (579us total) trans 0 rc 0/0 00010000:00010000:3.0:1787848442.450718:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450734:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848442.450788:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787848442.450792:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848442.450830:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450847:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450857:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbfca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450863:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbfca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450869:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbfca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450875:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848442.450879:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbfca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450908:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbfca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450923:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:3.0:1787848442.450926:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848442.450930:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbfca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450936:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cbfca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450952:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450958:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450963:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450968:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848442.450971:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450976:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.450983:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff53a89900) 00010000:00010000:3.0:1787848442.450986:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848442.450989:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.451004:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cbfd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.451047:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cbfc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb442 expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.451062:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb442 expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.451070:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:3.0:1787848442.451072:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848442.451074:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664200, rc 0) 00000100:00100000:3.0:1787848442.451151:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+45:11452:x1874694611476736:12345-192.168.201.26@tcp:101:stat.0 Request processed in 29808us (30121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848442.451161:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 156 00000100:00100000:2.0:1787848442.451388:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:1.0:1787848442.554196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848442.554320:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611477376 00000100:00100000:2.0:1787848442.554346:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611477376 00000100:00100000:2.0:1787848442.554414:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 157 00000100:00100000:2.0:1787848442.554424:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80786580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+44:11458:x1874694611477376:12345-192.168.201.26@tcp:36:truncate.0 00010000:00010000:2.0:1787848442.554491:0:9224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848442.554520:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cbfd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb442 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.554539:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:2.0:1787848442.554544:0:9224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848442.554830:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbfdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.554846:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbfdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.554857:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbfdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787848442.554911:0:9224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787848442.554937:0:9224:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000031368b9 reply state 00000000ab24f3a0 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbfdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848442.554947:0:9224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787848442.555044:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80786580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+46:11458:x1874694611477376:12345-192.168.201.26@tcp:36:truncate.0 Request processed in 621us (857us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787848442.555051:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 157 00000020:00080000:2.0:1787848442.555056:0:9224:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787848442.556909:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbfdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.556927:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbfdf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.556935:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbfdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.556942:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848442.556947:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbfdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.556955:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbfdf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.556992:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:3.0:1787848442.556995:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848442.556999:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbfdf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.557005:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cbfdf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848442.788287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848442.788611:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611477504 00000100:00100000:1.0:1787848442.788621:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611477504 00000100:00100000:1.0:1787848442.788701:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 158 00000100:00100000:1.0:1787848442.788714:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+45:11472:x1874694611477504:12345-192.168.201.26@tcp:101:stat.0 00010000:00010000:1.0:1787848442.788744:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848442.788767:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbfe6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb449 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.788868:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbfed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.788886:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbfed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.788899:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbfed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.788914:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbff4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.788922:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.788929:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.789386:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.789398:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.789405:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848442.789445:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787848442.789450:0:7097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848442.789473:0:7097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.789499:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.789508:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbfed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791249:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbfed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791265:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbfed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791275:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848442.791281:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbfed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791295:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbfed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791321:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:1.0:1787848442.791324:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848442.791329:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbfed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791336:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cbfed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791357:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791364:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbff4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791389:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791394:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848442.791398:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791404:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbff4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791412:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff43951300) 00010000:00010000:1.0:1787848442.791414:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848442.791418:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbff4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791424:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cbff4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791472:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cbfe6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb449 expref: 47 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791487:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb449 expref: 46 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848442.791495:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848442.791497:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787848442.791500:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42ec00, rc 0) 00000100:00100000:1.0:1787848442.791577:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+46:11472:x1874694611477504:12345-192.168.201.26@tcp:101:stat.0 Request processed in 2866us (3300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848442.791594:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 158 00000001:00080000:2.0:1787848442.821476:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000004:00080000:2.0:1787848442.821518:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787848442.821540:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ff5f4d8780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787848442.821558:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff6ecec400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ff5f4d80c0 00000020:00080000:2.0:1787848442.821561:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff6ecec500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ff792d8400 00000001:00080000:2.0:1787848442.821580:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000100:00100000:3.0:1787848442.821883:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787848442.821906:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5ee1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631408768:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787848442.821991:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848442.822074:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631408768 00000100:00100000:3.0:1787848442.822082:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631408768 00000100:00100000:3.0:1787848442.822362:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787848442.822374:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874694631408768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787848442.822405:0:6689:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1787848442.822440:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9066f9, atime: 0x6a9066f9, ctime: 0x6a9066f9, blocks: 0x1 00010000:00010000:3.0:1787848442.822450:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b5efc4/0x9aeb41e0543cc002 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.822467:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1787848442.822471:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848442.822478:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b5efc4/0x9aeb41e0543cc002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.822496:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b5efc4/0x9aeb41e0543cc002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.822521:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b5efc4/0x9aeb41e0543cc002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.822529:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b5efc4/0x9aeb41e0543cc002 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.822546:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787848442.823036:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848442.823045:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b5efc4/0x9aeb41e0543cc002 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.823054:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848442.823058:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b5efc4/0x9aeb41e0543cc002 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.823068:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b5efc4/0x9aeb41e0543cc002 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.823087:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b5efc4/0x9aeb41e0543cc002 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.823095:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b5efc4/0x9aeb41e0543cc002 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848442.823128:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848442.823130:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848442.823132:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787848442.823268:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787848442.823430:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00080000:3.0:1787848442.825998:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787848442.826612:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1874694631408768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4233us (4613us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787848442.826626:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1787848442.826946:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff5ee1de00/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787848442.826955:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5ee1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631408768:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787848442.931451:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848442.936347:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848442.936547:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611477760 00000100:00100000:3.0:1787848442.936558:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611477760 00000100:00100000:3.0:1787848442.936723:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 159 00000100:00100000:3.0:1787848442.936734:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+16:11482:x1874694611477760:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848442.936757:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848442.936780:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb450 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848442.937071:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787848442.937519:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc009 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb450 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.937534:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:3.0:1787848442.937536:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787848442.937548:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb450 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848442.937561:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236200, rc 0) 00000100:00100000:3.0:1787848442.937624:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:11482:x1874694611477760:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 892us (1291us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787848442.937632:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 159 00000100:00100000:0.0:1787848442.948624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848442.950322:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611478016 00000100:00100000:1.0:1787848442.950340:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611478016 00000100:00100000:1.0:1787848442.950607:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:1.0:1787848442.950620:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff47b4f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:11482:x1874694611478016:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848442.951485:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff47b4f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:11482:x1874694611478016:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 860us (2866us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787848442.951495:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:0.0:1787848443.063614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848443.063845:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611478272 00000100:00100000:2.0:1787848443.063870:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611478272 00000100:00100000:2.0:1787848443.063925:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 160 00000100:00100000:2.0:1787848443.063935:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:11488:x1874694611478272:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787848443.063961:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848443.063982:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc017 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb457 expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848443.064082:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848443.064114:0:9224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb449 expref: 19 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848443.064124:0:9224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848443.064164:0:9224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb449 expref: 19 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848443.064180:0:9224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb449 expref: 19 pid: 7097 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848443.064194:0:9224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78fa9680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631408896:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848443.064288:0:9224:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6ecee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848443.073989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.074464:0:9224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78fa9680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631408896:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787848443.074495:0:9224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848443.074809:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611478400 00000100:00100000:3.0:1787848443.074817:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611478400 00010000:00010000:3.0:1787848443.074859:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb449 expref: 20 pid: 7097 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848443.074904:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:3.0:1787848443.074914:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:2352:x1874694611478400:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848443.074934:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848443.074941:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb449 expref: 20 pid: 7097 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.074953:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb449 expref: 20 pid: 7097 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.074980:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cbffb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb449 expref: 20 pid: 7097 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.075000:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:3.0:1787848443.075006:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.075036:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.075045:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.075077:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787848443.075317:0:9224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.075337:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848443.075357:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787848443.075531:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc017 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb457 expref: 21 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.075547:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb457 expref: 20 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.075556:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848443.075559:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787848443.075568:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665800, rc 0) 00000100:00100000:3.0:1787848443.075700:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:2352:x1874694611478400:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 786us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848443.075709:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:1.0:1787848443.079425:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:11488:x1874694611478272:12345-192.168.201.26@tcp:101:bash.0 Request processed in 15466us (15798us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787848443.079438:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 160 00000100:00100000:0.0:1787848443.091462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.091563:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611478656 00000100:00100000:1.0:1787848443.091574:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611478656 00000100:00100000:1.0:1787848443.091670:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 161 00000100:00100000:1.0:1787848443.091683:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:11488:x1874694611478656:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:1.0:1787848443.092041:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc02c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.092058:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc02c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.092074:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc02c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787848443.092441:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1787848443.092476:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eab2477c reply state 00000000565c7f2d transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc02c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848443.092484:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787848443.092666:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:11488:x1874694611478656:12345-192.168.201.26@tcp:36:bash.0 Request processed in 958us (1186us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787848443.092674:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 161 00000020:00080000:1.0:1787848443.092679:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787848443.099915:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc02c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.099936:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc02c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.099943:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc02c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.099949:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848443.099954:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc02c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.099962:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc02c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.099980:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:0.0:1787848443.099983:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848443.099988:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc02c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.099994:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc02c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848443.102358:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848443.102697:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611478784 00000100:00100000:3.0:1787848443.102707:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611478784 00000100:00100000:3.0:1787848443.102761:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 162 00000100:00100000:3.0:1787848443.102771:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:11488:x1874694611478784:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787848443.102807:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848443.102831:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc033 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb45e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.102922:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc03a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.102938:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb457 expref: 22 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.102947:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc03a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.102981:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb457 expref: 22 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.103011:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb457 expref: 22 pid: 9224 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848443.103025:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5ee1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631409024:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848443.103121:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787848443.108272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848443.108420:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5ee1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631409024:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848443.108447:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc03a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848443.109529:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611478912 00000100:00100000:0.0:1787848443.109541:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611478912 00010000:00010000:0.0:1787848443.109584:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb457 expref: 23 pid: 9224 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848443.109709:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 66 00000100:00100000:0.0:1787848443.109721:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:2352:x1874694611478912:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848443.109737:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848443.109744:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb457 expref: 23 pid: 9224 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.109757:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb457 expref: 23 pid: 9224 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.109780:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc01e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb457 expref: 23 pid: 9224 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.109804:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:0.0:1787848443.109810:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc03a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.109819:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.109828:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc03a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.109861:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848443.109920:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:2352:x1874694611478912:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 201us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848443.109928:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 66 00010000:00010000:3.0:1787848443.109983:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.109992:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848443.110040:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787848443.110045:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848443.110065:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.110116:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc033 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb45e expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.110132:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc03a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb45e expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.110148:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:3.0:1787848443.110151:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848443.110154:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237000, rc 0) 00000100:00100000:3.0:1787848443.110184:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:11488:x1874694611478784:12345-192.168.201.26@tcp:101:bash.0 Request processed in 7415us (7837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848443.110202:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 162 00000100:00100000:2.0:1787848443.113630:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.113749:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611479168 00000100:00100000:1.0:1787848443.113759:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611479168 00000100:00100000:1.0:1787848443.113827:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:1.0:1787848443.113853:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:11488:x1874694611479168:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:1.0:1787848443.114138:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:11488:x1874694611479168:12345-192.168.201.26@tcp:35:bash.0 Request processed in 288us (516us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787848443.114148:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:1.0:1787848443.215877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848443.216008:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611479424 00000100:00100000:2.0:1787848443.216020:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611479424 00000100:00100000:2.0:1787848443.216101:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 163 00000100:00100000:2.0:1787848443.216115:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:11498:x1874694611479424:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848443.216149:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848443.216174:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc041 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb465 expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848443.216488:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787848443.216710:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc041 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb465 expref: 24 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848443.216725:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:2.0:1787848443.216728:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787848443.216733:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc041 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb465 expref: 24 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848443.216746:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664200, rc 0) 00000100:00100000:2.0:1787848443.217049:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:11498:x1874694611479424:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 935us (1190us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787848443.217058:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 163 00000100:00100000:2.0:1787848443.220799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.220881:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611479552 00000100:00100000:1.0:1787848443.220893:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611479552 00000100:00100000:1.0:1787848443.220962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 164 00000100:00100000:1.0:1787848443.220973:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:11498:x1874694611479552:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:1.0:1787848443.221059:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cc04f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221077:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cc04f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221098:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cc04f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221120:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221128:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221136:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221746:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc05d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221770:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221778:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787848443.221848:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221864:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cc04f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221872:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cc04f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221880:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cc04f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221886:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848443.221892:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cc04f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221899:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cc04f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221911:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:1.0:1787848443.221914:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848443.221919:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cc04f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221926:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cc04f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221946:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221952:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221958:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221963:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848443.221966:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221972:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221978:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff43951300) 00010000:00010000:1.0:1787848443.221981:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848443.221983:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc056 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.221989:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.222001:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.222008:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc05d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.222014:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc05d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.222023:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ec00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848443.222027:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc05d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.222032:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc05d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.222039:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848443.222041:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848443.222044:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc05d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.222049:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc05d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848443.222292:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:11498:x1874694611479552:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 1318us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848443.222303:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 164 00000100:00100000:3.0:1787848443.225153:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.225236:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611479808 00000100:00100000:1.0:1787848443.225246:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611479808 00000100:00100000:1.0:1787848443.225311:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:1.0:1787848443.225324:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:11498:x1874694611479808:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848443.225851:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:11498:x1874694611479808:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 528us (706us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787848443.225860:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:0.0:1787848443.273491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848443.273606:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611480064 00000100:00100000:3.0:1787848443.273617:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611480064 00000100:00100000:3.0:1787848443.273706:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 165 00000100:00100000:3.0:1787848443.273717:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:11501:x1874694611480064:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848443.273748:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848443.273771:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc064 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb46c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.273876:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc06b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.273894:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc06b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.273908:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc06b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.273924:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc072 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.273930:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.273935:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274349:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274369:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274377:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848443.274388:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787848443.274486:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc06b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274493:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc06b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274499:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc06b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274505:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848443.274509:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc06b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274517:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc06b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274531:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:3.0:1787848443.274534:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848443.274538:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc06b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274544:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc06b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274557:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274567:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc072 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274573:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc072 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274578:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848443.274581:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc072 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274587:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc072 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274595:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff541a1500) 00010000:00010000:3.0:1787848443.274597:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848443.274600:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc072 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274606:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc072 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274723:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc064 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb46c expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274736:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb46c expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.274742:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:3.0:1787848443.274744:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848443.274751:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236c00, rc 0) 00000100:00100000:3.0:1787848443.274841:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11501:x1874694611480064:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1124us (1360us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1787848443.274849:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 165 00000100:00100000:2.0:1787848443.279513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.279592:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611480192 00000100:00100000:1.0:1787848443.279604:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611480192 00000100:00100000:1.0:1787848443.279696:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00100000:1.0:1787848443.279725:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11501:x1874694611480192:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:1.0:1787848443.279803:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.279820:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.279832:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.279860:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.279867:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc087 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.279875:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.279881:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ec00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848443.279885:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.279893:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc087 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.279904:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848443.279906:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787848443.279910:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc087 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.279917:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848443.279990:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11501:x1874694611480192:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 267us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848443.280003:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00100000:2.0:1787848443.282439:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.282522:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611480448 00000100:00100000:1.0:1787848443.282532:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611480448 00000100:00100000:1.0:1787848443.282592:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:1.0:1787848443.282602:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11501:x1874694611480448:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848443.282911:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:11501:x1874694611480448:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 309us (481us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787848443.282919:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:0.0:1787848443.291683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.291897:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611480576 00000100:00100000:1.0:1787848443.291907:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611480576 00000100:00100000:1.0:1787848443.291975:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:1.0:1787848443.291985:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:2351:x1874694611480576:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848443.292000:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848443.292027:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb46c expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.292048:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848443.292053:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848443.292135:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:2351:x1874694611480576:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 151us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848443.292143:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:2.0:1787848443.531505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.532006:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611480832 00000100:00100000:1.0:1787848443.532018:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611480832 00000100:00100000:1.0:1787848443.532114:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 167 00000100:00100000:1.0:1787848443.532124:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11519:x1874694611480832:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:1.0:1787848443.532154:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848443.532176:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc08e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb473 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.532290:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc095 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.532306:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.532319:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848443.532331:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787848443.532502:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc08e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb473 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.532524:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb473 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.532534:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:1.0:1787848443.532537:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787848443.532540:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e400, rc 0) 00000100:00100000:1.0:1787848443.532611:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:11519:x1874694611480832:12345-192.168.201.26@tcp:101:cat.0 Request processed in 488us (1118us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787848443.532618:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 167 00000100:00100000:2.0:1787848443.583188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848443.583291:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611480960 00000100:00100000:0.0:1787848443.583301:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611480960 00000100:00100000:0.0:1787848443.583373:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 168 00000100:00100000:0.0:1787848443.583385:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:11520:x1874694611480960:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848443.583424:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848443.583449:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc0a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb47a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.583525:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc0aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.583541:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc0aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.583551:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc0aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848443.583828:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787848443.583833:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848443.583918:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc0aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.583950:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc0a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb47a expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.583971:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc0aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb47a expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.583980:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:0.0:1787848443.583991:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848443.583995:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148ca00, rc 0) 00000100:00100000:0.0:1787848443.584068:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11520:x1874694611480960:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 684us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848443.584076:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 168 00000100:00100000:0.0:1787848443.593354:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.593678:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611481344 00000100:00100000:1.0:1787848443.593700:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611481344 00000100:00100000:1.0:1787848443.593757:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:1.0:1787848443.593767:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11520:x1874694611481344:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848443.594670:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:11520:x1874694611481344:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 873us (1296us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787848443.594679:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:2.0:1787848443.600236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848443.600349:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611481472 00000100:00100000:0.0:1787848443.600360:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611481472 00000100:00100000:0.0:1787848443.600479:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:0.0:1787848443.600490:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f0212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:11520:x1874694611481472:12345-192.168.201.26@tcp:103:lfs.0 00010000:00010000:0.0:1787848443.600508:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787848443.600535:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc03a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb45e expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.600558:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cc095 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb473 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.600572:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ea00/0x9aeb41e0543cbf3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb41f expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.600582:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951100) 00010000:00010000:0.0:1787848443.600593:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848443.600706:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f0212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:11520:x1874694611481472:12345-192.168.201.26@tcp:103:lfs.0 Request processed in 219us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848443.600714:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:2.0:1787848443.606524:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.606730:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611481600 00000100:00100000:1.0:1787848443.606742:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611481600 00000100:00100000:1.0:1787848443.607884:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 169 00000100:00100000:1.0:1787848443.607903:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f021e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:11520:x1874694611481600:12345-192.168.201.26@tcp:58:lfs.0 00010000:00010000:1.0:1787848443.608046:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc0b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.608067:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848443.608090:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787848443.608467:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787848443.608567:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f021e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:11520:x1874694611481600:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 672us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848443.608576:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 169 00000100:00100000:2.0:1787848443.667861:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848443.668011:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611481728 00000100:00100000:3.0:1787848443.668021:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611481728 00000100:00100000:3.0:1787848443.668100:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 170 00000100:00100000:3.0:1787848443.668111:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f021a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:11522:x1874694611481728:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848443.668146:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848443.668169:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb481 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668235:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668251:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668261:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668275:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668282:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668289:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668695:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668714:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668721:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848443.668762:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787848443.668782:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848443.668813:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668828:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668837:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668845:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668851:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668857:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848443.668862:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668871:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668886:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:3.0:1787848443.668889:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848443.668903:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668909:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668925:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668931:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668937:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668942:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848443.668946:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668951:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668959:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff541a1500) 00010000:00010000:3.0:1787848443.668961:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848443.668964:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.668970:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.669019:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb481 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.669045:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb481 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.669052:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951300) 00010000:00010000:3.0:1787848443.669055:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787848443.669057:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237c00, rc 0) 00000100:00100000:3.0:1787848443.669129:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f021a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:11522:x1874694611481728:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1020us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848443.669139:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 170 00000001:00080000:3.0:1787848443.909242:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1787848443.909257:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1787848443.909272:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000040:00080000:3.0:1787848443.951926:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787848443.951937:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787848443.952002:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787848443.952024:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787848443.952198:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5ee1cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631409152:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787848443.952315:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028ccc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787848443.954030:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848443.971173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848443.971246:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611481856 00000100:00100000:1.0:1787848443.971258:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611481856 00000100:00100000:1.0:1787848443.971331:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 171 00000100:00100000:1.0:1787848443.971342:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f022940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11533:x1874694611481856:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787848443.971375:0:9224:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787848443.971492:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f022940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11533:x1874694611481856:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 152us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848443.971500:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 171 00000100:00100000:0.0:1787848443.971586:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5ee1cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631409152:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787848443.983880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848443.984136:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611481984 00000100:00100000:3.0:1787848443.984147:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611481984 00000100:00100000:3.0:1787848443.984207:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 172 00000100:00100000:3.0:1787848443.984218:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f020b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:11533:x1874694611481984:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787848443.984294:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984312:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984338:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984508:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984517:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984524:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984549:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984556:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984562:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848443.984595:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787848443.984599:0:7097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848443.984611:0:7097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984622:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984628:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0d4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984676:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984683:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848443.984687:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984694:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0d4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984704:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:3.0:1787848443.984707:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848443.984711:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984717:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc0d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984729:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984734:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0db lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984739:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984742:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848443.984745:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984758:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0db lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984765:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff93ff541a1500) 00010000:00010000:3.0:1787848443.984767:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848443.984769:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0db lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984774:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc0db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984810:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984816:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984820:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984824:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848443.984827:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984832:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984837:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951300) 00010000:00010000:3.0:1787848443.984839:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848443.984841:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848443.984855:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc0e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848443.984927:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f020b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:11533:x1874694611481984:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 Request processed in 710us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848443.984935:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 172 00000100:00100000:2.0:1787848443.988980:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848443.992763:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611482240 00000100:00100000:0.0:1787848443.992806:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611482240 00000100:00100000:0.0:1787848443.992887:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 173 00000100:00100000:0.0:1787848443.992897:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f0203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:11533:x1874694611482240:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787848443.992918:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848443.992950:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc0e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb488 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993056:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc0f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993072:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993084:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848443.993094:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787848443.993193:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993202:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc0f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993208:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc0f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993214:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848443.993218:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc0f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993226:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc0f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993248:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951300) 00010000:00010000:0.0:1787848443.993251:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848443.993256:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc0f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993262:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc0f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993307:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc0e9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb488 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993318:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:0.0:1787848443.993320:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787848443.993324:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc0e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb488 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848443.993333:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c800, rc 0) 00000100:00100000:0.0:1787848443.993409:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f0203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11533:x1874694611482240:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 514us (4437us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1787848443.993418:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 173 00000100:00100000:2.0:1787848444.006092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848444.006169:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611482368 00000100:00100000:0.0:1787848444.006183:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611482368 00000100:00100000:0.0:1787848444.006278:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 174 00000100:00100000:0.0:1787848444.006293:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f023c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11533:x1874694611482368:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787848444.006349:0:5842:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787848444.006487:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f023c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11533:x1874694611482368:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 199us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848444.006507:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 174 00000100:00080000:3.0:1787848444.011963:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848444.017156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848444.017253:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611482624 00000100:00100000:2.0:1787848444.017264:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611482624 00000100:00100000:2.0:1787848444.017347:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 175 00000100:00100000:2.0:1787848444.017359:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11533:x1874694611482624:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848444.017386:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848444.017389:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787848444.017421:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc0aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb47a expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.017447:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:2.0:1787848444.017454:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848444.017471:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc0fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb48f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787848444.018396:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787848444.018689:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc105 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.018704:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.018722:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.018796:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc0fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb48f expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.018813:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb48f expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.018821:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:2.0:1787848444.018824:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787848444.018827:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664200, rc 0) 00000100:00100000:2.0:1787848444.018891:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:11533:x1874694611482624:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 1535us (1748us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787848444.018899:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 175 00000100:00100000:2.0:1787848444.029622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848444.029804:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611482880 00000100:00100000:1.0:1787848444.029815:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611482880 00000100:00100000:1.0:1787848444.029877:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 176 00000100:00100000:1.0:1787848444.029887:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:11533:x1874694611482880:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787848444.030085:0:9224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848444.030115:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc105 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb48f expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030136:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:1.0:1787848444.030149:0:9224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787848444.030176:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc113 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030190:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc113 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030200:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc113 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030215:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cc11a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1304c7fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030223:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cc11a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1304c7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030229:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cc11a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1304c7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030522:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc113 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030531:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc113 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030537:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc113 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030542:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848444.030546:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc113 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030553:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc113 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030562:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:1.0:1787848444.030565:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848444.030569:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc113 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030574:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc113 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030583:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cc11a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1304c7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030589:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cc11a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1304c7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030595:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cc11a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1304c7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030607:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848444.030610:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cc11a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1304c7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030616:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cc11a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1304c7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030625:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1304c7fa (ffff93ff43951800) 00010000:00010000:1.0:1787848444.030628:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848444.030630:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cc11a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1304c7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.030636:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cc11a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1304c7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848444.030770:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11533:x1874694611482880:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 884us (1171us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787848444.030789:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 176 00000100:00100000:1.0:1787848444.037359:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848444.037838:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611483008 00000100:00100000:3.0:1787848444.037847:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611483008 00000100:00100000:3.0:1787848444.037966:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 177 00000100:00100000:3.0:1787848444.037979:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80785a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11533:x1874694611483008:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787848444.038000:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848444.038024:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc121 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb496 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.038061:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.038096:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.038108:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.038221:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb496 expref: 31 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.038250:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb496 expref: 30 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.038259:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:3.0:1787848444.038262:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787848444.038266:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237400, rc 0) 00000100:00100000:3.0:1787848444.038339:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80785a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:11533:x1874694611483008:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 363us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848444.038346:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 177 00000100:00100000:2.0:1787848444.051593:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848444.055803:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611483264 00000100:00100000:0.0:1787848444.055819:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611483264 00000100:00100000:0.0:1787848444.055905:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 178 00000100:00100000:0.0:1787848444.055916:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:11533:x1874694611483264:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787848444.056012:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc12f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.056027:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc12f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.056038:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc12f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787848444.056347:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787848444.056359:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392967718454ns, next at 393967714983ns, rc = 0 00000004:00010000:0.0:1787848444.056455:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8a0d02f reply state 00000000df8c2ff9 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc12f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848444.056465:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787848444.059203:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:11533:x1874694611483264:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 1005us (5336us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787848444.059224:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 178 00010000:00010000:3.0:1787848444.077880:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc12f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.077900:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc12f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.077907:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc12f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.077913:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848444.077918:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc12f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.077926:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc12f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.077942:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:3.0:1787848444.077945:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787848444.077949:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc12f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.077980:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc12f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848444.079028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848444.079092:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611483392 00000100:00100000:1.0:1787848444.079102:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611483392 00000100:00100000:1.0:1787848444.079163:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 179 00000100:00100000:1.0:1787848444.079174:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f0221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+31:11533:x1874694611483392:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787848444.079198:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848444.079216:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc136 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb49d expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.079277:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc136 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb49d expref: 32 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.079303:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc136 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb49d expref: 32 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.079324:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:1.0:1787848444.079327:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787848444.079330:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f600, rc 0) 00000100:00100000:1.0:1787848444.079390:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f0221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:11533:x1874694611483392:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 218us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848444.079398:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 179 00000100:00100000:3.0:1787848444.093154:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848444.093413:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611483520 00000100:00100000:0.0:1787848444.093424:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611483520 00000100:00100000:0.0:1787848444.093494:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:0.0:1787848444.093504:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611483520:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787848444.093852:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2353:x1874694611483520:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 349us (707us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787848444.093875:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00080000:3.0:1787848444.093973:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787848444.096721:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848444.096826:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611483776 00000100:00100000:0.0:1787848444.096835:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611483776 00000100:00100000:0.0:1787848444.096887:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:0.0:1787848444.096897:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:11533:x1874694611483776:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787848444.097141:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+33:11533:x1874694611483776:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 244us (428us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787848444.097149:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:3.0:1787848444.108739:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848444.108795:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611484032 00000100:00100000:2.0:1787848444.108806:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611484032 00000100:00100000:0.0:1787848444.108947:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 180 00000100:00100000:0.0:1787848444.108961:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+33:11533:x1874694611484032:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787848444.109105:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+33:11533:x1874694611484032:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 147us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848444.109113:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 180 00000100:00100000:3.0:1787848444.113281:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848444.113425:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611484160 00000100:00100000:0.0:1787848444.113435:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611484160 00000100:00100000:0.0:1787848444.113497:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 181 00000100:00100000:0.0:1787848444.113507:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+33:11533:x1874694611484160:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787848444.113530:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848444.113553:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc13d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4a4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.113622:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.113662:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.113691:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848444.113728:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848444.113746:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.113772:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc13d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4a4 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.113801:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4a4 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.113809:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:0.0:1787848444.113812:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787848444.113816:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c000, rc 0) 00000100:00100000:0.0:1787848444.113880:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:11533:x1874694611484160:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 375us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848444.113888:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 181 00000100:00100000:3.0:1787848444.121456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848444.123165:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611484288 00000100:00100000:2.0:1787848444.123187:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611484288 00000100:00100000:2.0:1787848444.123272:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:2.0:1787848444.123284:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611484288:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848444.123306:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848444.123328:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc14b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4ab expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787848444.123385:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9066fc, blocks: 0x1 00010000:00010000:2.0:1787848444.123407:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787848444.123412:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848444.123421:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc14b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ab expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.123441:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc14b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ab expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.123455:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664a00, rc 0) 00000100:00100000:2.0:1787848444.123525:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611484288:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 244us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848444.123533:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:2.0:1787848444.132729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848444.132830:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611484544 00000100:00100000:1.0:1787848444.132840:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611484544 00000100:00100000:1.0:1787848444.132913:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 182 00000100:00100000:1.0:1787848444.132924:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f020f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:11533:x1874694611484544:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787848444.133049:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f020f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:11533:x1874694611484544:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 126us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848444.133058:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 182 00000100:00100000:1.0:1787848444.140392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848444.140627:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611484672 00000100:00100000:0.0:1787848444.140716:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611484672 00000100:00100000:1.0:1787848444.140865:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:1.0:1787848444.140877:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:11533:x1874694611484672:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787848444.140896:0:11455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848444.140915:0:11455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4b2 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.141198:0:11455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc14b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ab expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.141216:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848444.141221:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848444.141228:0:11455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 9 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.141263:0:11455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc14b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ab expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.141280:0:11455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc14b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ab expref: 9 pid: 6690 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848444.141296:0:11455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80787c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11455:1874694631409280:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787848444.141443:0:11455:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff41376000 going to sleep for 11 seconds 00000100:00100000:1.0:1787848444.151914:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848444.151973:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611484800 00000100:00100000:1.0:1787848444.151982:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611484800 00010000:00010000:1.0:1787848444.152032:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc14b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ab expref: 10 pid: 6690 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848444.152069:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 67 00000100:00100000:1.0:1787848444.152088:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:2351:x1874694611484800:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848444.152105:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848444.152130:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc14b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ab expref: 10 pid: 6690 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.152156:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc14b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ab expref: 10 pid: 6690 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.152183:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848444.152187:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848444.152197:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 10 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.152207:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 10 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.152246:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 10 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848444.152260:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80784b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1874694631409408:192.168.201.26@tcp:105: 00000100:00100000:1.0:1787848444.152342:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff41376540 going to sleep for 11 seconds 00010000:00010000:3.0:1787848444.156164:0:11455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc14b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ab expref: 10 pid: 6690 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848444.156192:0:11455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80787c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11455:1874694631409280:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848444.156226:0:11455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 9 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848444.156228:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80784b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1874694631409408:192.168.201.26@tcp:105: 00010000:00010000:2.0:1787848444.156241:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848444.156242:0:11455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42fe00, rc 0) 00000100:00100000:2.0:1787848444.156291:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2351:x1874694611484800:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 4214us (4387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848444.156302:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 67 00000100:00100000:3.0:1787848444.161539:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:11533:x1874694611484672:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 20652us (21143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848444.161554:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:1.0:1787848444.177597:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848444.177768:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611484928 00000100:00100000:0.0:1787848444.177787:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611484928 00002000:00100000:0.0:1787848444.177842:0:6696:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93ff807843c0 x1874694611484928/t0(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:150/0 lens 504/0 e 0 to 0 dl 1787848455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787848444.177854:0:6696:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff807843c0 with x1874694611484928 ext(0->8) 00002000:00010000:0.0:1787848444.177859:0:6696:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff807843c0 00000100:00100000:0.0:1787848444.177900:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:0.0:1787848444.177909:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2351:x1874694611484928:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787848444.178403:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:2351:x1874694611484928:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 Request processed in 492us (812us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787848444.178412:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00002000:00100000:0.0:1787848444.178420:0:6696:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93ff807843c0 x1874694611484928/t4294967314(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:150/0 lens 504/448 e 0 to 0 dl 1787848455 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787848444.178428:0:6696:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff807843c0 with x1874694611484928 ext(0->8) 00002000:00010000:0.0:1787848444.178431:0:6696:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff807843c0 00000100:00100000:3.0:1787848444.182282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848444.183634:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611485056 00000100:00100000:1.0:1787848444.183664:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611485056 00000100:00100000:1.0:1787848444.183728:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 183 00000100:00100000:1.0:1787848444.183738:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:11533:x1874694611485056:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787848444.275765:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f021680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631409536:0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.276157:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848444.276213:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f022580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631410048:0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.276241:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848444.276279:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787848444.276286:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f020780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631409920:0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.276311:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848444.276343:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f022d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631409664:0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.276366:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848444.276384:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79416580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631410176:0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.276405:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848444.276422:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848444.276427:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f023840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631409792:0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.276446:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848444.276477:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631409536 00000100:00100000:2.0:1787848444.276484:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631409536 00000100:00100000:2.0:1787848444.276530:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787848444.276539:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631409536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.276677:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631409536:12345-0@lo:400:kworker.0 Request processed in 138us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848444.276685:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787848444.276717:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631410048 00000100:00100000:2.0:1787848444.276721:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631410048 00000100:00100000:2.0:1787848444.276749:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631409664 00000100:00100000:2.0:1787848444.276752:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631409664 00000100:00100000:2.0:1787848444.276763:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631409792 00000100:00100000:2.0:1787848444.276765:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631409792 00000100:00100000:2.0:1787848444.276791:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787848444.276797:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631410048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.276828:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631410048:12345-0@lo:400:kworker.0 Request processed in 32us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848444.276834:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787848444.277393:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787848444.277401:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79415a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631409664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.277445:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79415a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631409664:12345-0@lo:400:kworker.0 Request processed in 45us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848444.277451:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787848444.277463:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787848444.277468:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631409792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.277496:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631409792:12345-0@lo:400:kworker.0 Request processed in 28us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848444.277502:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787848444.277520:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631409920 00000100:00100000:2.0:1787848444.277524:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631409920 00000100:00100000:1.0:1787848444.277746:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f023840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631409792:0@lo:400:kworker.0 00000100:00100000:1.0:1787848444.277758:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f022d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631409664:0@lo:400:kworker.0 00000100:00100000:1.0:1787848444.277981:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631410176 00000100:00100000:1.0:1787848444.277987:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631410176 00000100:00100000:1.0:1787848444.278039:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787848444.278047:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79415e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631409920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848444.278205:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79415e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631409920:12345-0@lo:400:kworker.0 Request processed in 42us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848444.278212:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787848444.278226:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787848444.278233:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631410176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848444.278266:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631410176:12345-0@lo:400:kworker.0 Request processed in 34us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848444.278272:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787848444.278434:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79416580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631410176:0@lo:400:kworker.0 00000100:00080000:2.0:1787848444.278657:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787848444.278661:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787848444.278665:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848444.278691:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1787848444.278697:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1787848444.278715:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff5ee1de00, transno 4294967307 00000100:00100000:2.0:1787848444.278728:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f020780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631409920:0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.278739:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f021680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631409536:0@lo:400:kworker.0 00000100:00100000:2.0:1787848444.278750:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f022580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631410048:0@lo:400:kworker.0 00000001:00080000:2.0:1787848444.292377:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1787848444.292401:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1787848444.292429:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1787848444.292487:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787848444.292496:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787848444.292713:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848444.292734:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5ee1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631410304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787848444.292814:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848444.292870:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631410304 00000100:00100000:3.0:1787848444.292884:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631410304 00000100:00100000:3.0:1787848444.292929:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787848444.292938:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631410304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787848444.293364:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787848444.293368:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787848444 00002000:00010000:3.0:1787848444.293371:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787848444.293373:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787848444 -> 1787848444 00002000:00010000:3.0:1787848444.293375:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787848444.293418:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874694631410304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 480us (603us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787848444.293426:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1787848444.293485:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff5ee1c000/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787848444.293491:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5ee1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631410304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787848444.294818:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:11533:x1874694611485056:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 Request processed in 111075us (112537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848444.294828:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 183 00000100:00100000:3.0:1787848444.301113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848444.301187:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611485184 00000100:00100000:1.0:1787848444.301196:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611485184 00000100:00100000:1.0:1787848444.301254:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:1.0:1787848444.301263:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:2352:x1874694611485184:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787848444.366349:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:2352:x1874694611485184:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 Request processed in 65077us (65236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848444.366364:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:3.0:1787848444.370220:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848444.371023:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611485440 00000100:00100000:2.0:1787848444.371036:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611485440 00000100:00100000:2.0:1787848444.371114:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 184 00000100:00100000:2.0:1787848444.371126:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:11533:x1874694611485440:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787848444.371184:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848444.371216:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4a4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.371236:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:2.0:1787848444.371241:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848444.371273:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc159 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.371287:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.371297:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787848444.371915:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fa27b09 reply state 0000000089e76632 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848444.371925:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787848444.373143:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:1.0:1787848444.373167:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1787848444.373356:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:11533:x1874694611485440:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 2227us (3141us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787848444.373368:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 184 00000100:00100000:1.0:1787848444.381126:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:2.0:1787848444.381350:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.381363:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc159 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.381384:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.381391:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848444.381396:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.381414:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc159 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.381435:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:2.0:1787848444.381438:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848444.381443:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc159 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.381450:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc159 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848444.384755:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611485568 00000100:00100000:3.0:1787848444.384783:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611485568 00000100:00100000:3.0:1787848444.384905:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:3.0:1787848444.384916:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611485568:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787848444.386577:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787848444.386584:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787848444 -> 1787848443 00002000:00010000:3.0:1787848444.386587:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787848441 00002000:00010000:3.0:1787848444.386590:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787848444 -> 1787848443 00002000:00010000:3.0:1787848444.386592:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787848444.386691:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2351:x1874694611485568:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 1774us (5575us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787848444.386715:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:2.0:1787848444.397301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848444.397512:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611485824 00000100:00100000:3.0:1787848444.397523:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611485824 00000100:00100000:3.0:1787848444.397662:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 185 00000100:00100000:3.0:1787848444.397675:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79416940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:11533:x1874694611485824:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787848444.397753:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.397769:0:9224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc128 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb496 expref: 18 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.397792:0:9224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.397827:0:9224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb496 expref: 18 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.397840:0:9224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb496 expref: 18 pid: 7097 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848444.397854:0:9224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5ee1ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631410432:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848444.397944:0:9224:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787848444.405429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848444.405794:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611485952 00000100:00100000:0.0:1787848444.405807:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611485952 00010000:00010000:0.0:1787848444.405858:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc128 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb496 expref: 19 pid: 7097 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848444.405904:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:0.0:1787848444.405914:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f9fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:2352:x1874694611485952:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848444.405931:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848444.405938:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc128 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb496 expref: 19 pid: 7097 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.405953:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb496 expref: 19 pid: 7097 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.405978:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:0.0:1787848444.405983:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.406002:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.406010:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.406815:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848444.406871:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f9fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:2352:x1874694611485952:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 958us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848444.406879:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 68 00010000:00010000:3.0:1787848444.407461:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc128 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb496 expref: 18 pid: 7097 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848444.407479:0:9224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5ee1ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631410432:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848444.407513:0:9224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.407523:0:9224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.407528:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.407926:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.407934:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.407941:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.407946:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848444.407951:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.407959:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.407971:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:3.0:1787848444.407974:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787848444.407978:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.407984:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc160 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848444.408220:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79416940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:11533:x1874694611485824:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 Request processed in 10547us (10927us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787848444.408229:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 185 00000100:00100000:0.0:1787848444.419885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848444.419961:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611486080 00000100:00100000:3.0:1787848444.419970:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611486080 00000100:00100000:3.0:1787848444.420043:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:3.0:1787848444.420053:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611486080:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787848444.420117:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.420138:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 8 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.420148:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848444.420152:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787848444.420157:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.420192:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 8 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.420206:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 8 pid: 11455 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848444.420221:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5ee1ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874694631410560:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848444.420318:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787848444.429056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848444.429140:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611486208 00000100:00100000:0.0:1787848444.429150:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611486208 00010000:00010000:0.0:1787848444.429197:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 9 pid: 11455 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848444.429242:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:0.0:1787848444.429251:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79414b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2351:x1874694611486208:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848444.429265:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848444.429291:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 9 pid: 11455 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.429305:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 9 pid: 11455 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.429331:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848444.429336:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848444.429360:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.429370:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.429391:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848444.429449:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79414b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2351:x1874694611486208:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 199us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848444.429457:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 69 00010000:00010000:3.0:1787848444.430008:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029fdd580/0x9aeb41e0543cc152 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b2 expref: 8 pid: 11455 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848444.430033:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5ee1ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874694631410560:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848444.430056:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.430077:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.430090:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.430118:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.430127:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.430136:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.430143:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237800 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848444.430147:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.430170:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.430183:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.430190:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7a48250/0x9aeb41e0543cc167 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848444.430251:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611486080:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 Request processed in 10199us (10375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848444.430259:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:2.0:1787848444.435251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848444.435307:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611486464 00000100:00100000:1.0:1787848444.435318:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611486464 00000100:00100000:1.0:1787848444.435423:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 186 00000100:00100000:1.0:1787848444.435435:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+17:11533:x1874694611486464:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787848444.435512:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc16e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.435529:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.435541:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.435909:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.435921:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc136 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb49d expref: 18 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.435929:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.435961:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc136 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb49d expref: 18 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.435979:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc136 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb49d expref: 18 pid: 9224 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848444.435995:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80786940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631410688:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787848444.436199:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff44f929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848444.440919:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848444.440996:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611486592 00000100:00100000:2.0:1787848444.441009:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611486592 00010000:00010000:2.0:1787848444.441072:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc136 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb49d expref: 19 pid: 9224 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848444.441120:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:2.0:1787848444.441129:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:2351:x1874694611486592:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848444.441161:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848444.441169:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc136 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb49d expref: 19 pid: 9224 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.441183:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc136 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb49d expref: 19 pid: 9224 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.441208:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:2.0:1787848444.441213:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.441221:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.441229:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.441248:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848444.441308:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:2351:x1874694611486592:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 179us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848444.441317:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 70 00010000:00010000:1.0:1787848444.441399:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc136 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb49d expref: 18 pid: 9224 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848444.441416:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80786940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631410688:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787848444.441442:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.441452:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.441458:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787848444.441702:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787848444.441866:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787848444.441909:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787848444.441984:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80786940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874694631410816:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787848444.442034:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848444.442060:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6eceed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787848444.442523:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631410816 00000100:00100000:0.0:1787848444.442530:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631410816 00000100:00100000:0.0:1787848444.442572:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787848444.442580:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1874694631410816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787848444.442685:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1874694631410816:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848444.442692:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787848444.443115:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787848444.443123:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff5ee1c000, transno 4294967315 00000100:00100000:1.0:1787848444.443140:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80786940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874694631410816:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787848444.443609:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787848444.443719:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80786940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874694631410944:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787848444.443785:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848444.443803:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f4d8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787848444.444410:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631410944 00000100:00100000:0.0:1787848444.444418:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631410944 00000100:00100000:0.0:1787848444.444463:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787848444.444472:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1874694631410944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787848444.444694:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1874694631410944:12345-0@lo:1000:mdt00_000.0 Request processed in 222us (910us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787848444.444702:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787848444.445283:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80786940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874694631410944:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787848444.445331:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445341:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445350:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445356:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848444.445361:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445369:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445385:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff541a1500) 00010000:00010000:1.0:1787848444.445388:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787848444.445393:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445410:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc175 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445451:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445458:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc0b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445463:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc0b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445477:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ec00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848444.445481:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc0b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445486:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc0b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445495:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951300) 00010000:00010000:1.0:1787848444.445498:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787848444.445501:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc0b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445507:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc0b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445527:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445540:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb481 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445549:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445576:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb481 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.445589:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb481 expref: 21 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848444.445614:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80785680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631411072:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787848444.445754:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f4d8300 going to sleep for 11 seconds 00000100:00100000:1.0:1787848444.450574:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80785680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631411072:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787848444.450610:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848444.452745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848444.452869:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611486720 00000100:00100000:0.0:1787848444.452877:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611486720 00010000:00010000:0.0:1787848444.452933:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb481 expref: 22 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848444.452977:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00100000:0.0:1787848444.452986:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:2351:x1874694611486720:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848444.453000:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848444.453007:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb481 expref: 22 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.453020:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb481 expref: 22 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.453043:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc0cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb481 expref: 22 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.453061:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951300) 00010000:00010000:0.0:1787848444.453066:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.453089:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.453097:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.453127:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787848444.453231:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453240:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453252:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453259:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453265:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453272:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848444.453275:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453282:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453292:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951300) 00010000:00010000:1.0:1787848444.453301:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848444.453306:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453313:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc17c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453325:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453331:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc16e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453337:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc16e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453342:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42fa00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848444.453344:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc16e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453350:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc16e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453358:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951300) 00010000:00010000:1.0:1787848444.453360:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787848444.453363:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc16e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.453369:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc16e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848444.453685:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:2351:x1874694611486720:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 698us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848444.453694:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 71 00000040:00080000:0.0:1787848444.453819:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787848444.453824:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787848444.454298:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787848444.454305:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787848444.458364:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:11533:x1874694611486464:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 22916us (23105us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1787848444.458417:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 186 00000020:00080000:1.0:1787848444.458426:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787848444.462594:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848444.462837:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611486976 00000100:00100000:3.0:1787848444.462847:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611486976 00000100:00100000:3.0:1787848444.462934:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:3.0:1787848444.462944:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff47b4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:11533:x1874694611486976:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787848444.467787:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787848444.467880:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787848444.467940:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc183 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.467957:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.467970:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.467979:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc183 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.467986:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc183 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.467992:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc183 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.468017:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787848444.468160:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848444.468168:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc183 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.468176:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c800 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848444.468179:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc183 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.468185:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc183 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.468201:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ff48373600) 00010000:00010000:2.0:1787848444.468202:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787848444.468206:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc183 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.468210:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc183 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.468224:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848444.468225:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848444.468226:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848444.468287:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff47b4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:11533:x1874694611486976:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 5337us (5696us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787848444.468298:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 50 00000020:00080000:0.0:1787848444.468305:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1787848444.675520:0:12484:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787848444.675531:0:12484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787848444.676348:0:12484:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787848444.676357:0:12484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787848444.784586:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787848444.784610:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5ee1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631411200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848444.784705:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848444.784742:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787848444.784752:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff80785680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631411328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848444.784797:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848444.784867:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631411200 00000100:00100000:3.0:1787848444.784874:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631411200 00000100:00100000:3.0:1787848444.784921:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631411328 00000100:00100000:3.0:1787848444.784924:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631411328 00000100:00100000:3.0:1787848444.784947:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787848444.784955:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79417c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874694631411200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787848444.784978:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787848444.785037:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79417c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874694631411200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848444.785044:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787848444.785058:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5ee1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631411200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848444.785070:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787848444.785083:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631411328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787848444.785109:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848444.785139:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631411328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848444.785145:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787848444.785438:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff80785680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631411328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848444.880872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848444.880908:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611487232 00000100:00100000:3.0:1787848444.881562:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611487232 00000100:00100000:3.0:1787848444.881628:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 187 00000100:00100000:3.0:1787848444.881661:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:11544:x1874694611487232:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848444.881686:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848444.881706:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc18a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4b9 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.882896:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc191 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.882913:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc191 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.882926:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc191 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848444.882948:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787848444.883179:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc18a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b9 expref: 25 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.883198:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b9 expref: 24 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848444.883207:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:3.0:1787848444.883210:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787848444.883213:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237400, rc 0) 00000100:00100000:3.0:1787848444.883295:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:11544:x1874694611487232:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1658us (2433us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787848444.883303:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 187 00000100:00100000:0.0:1787848444.888003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848444.888041:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611487360 00000100:00100000:0.0:1787848444.888052:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611487360 00000100:00100000:0.0:1787848444.888106:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 188 00000100:00100000:0.0:1787848444.888116:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:11544:x1874694611487360:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:0.0:1787848444.888192:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc19f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.888210:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc19f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.888222:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc19f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.888238:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.888245:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.888252:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.889390:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.889403:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.889423:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787848444.889465:0:9224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.889479:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc19f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.889486:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc19f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890336:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc19f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890344:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148d400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848444.890349:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc19f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890357:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc19f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890371:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:0.0:1787848444.890374:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848444.890379:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc19f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890386:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc19f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890400:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890414:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890420:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890425:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848444.890428:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890435:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890444:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff48373800) 00010000:00010000:0.0:1787848444.890447:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848444.890450:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890456:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890473:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890479:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890485:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890490:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848444.890509:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890516:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890522:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff48373600) 00010000:00010000:0.0:1787848444.890524:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848444.890525:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848444.890529:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848444.890618:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:11544:x1874694611487360:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 2499us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848444.890628:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 188 00000100:00100000:0.0:1787848444.958339:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848444.958453:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611487616 00000100:00100000:1.0:1787848444.958463:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611487616 00000100:00100000:1.0:1787848444.958554:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 189 00000100:00100000:1.0:1787848444.958566:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:11547:x1874694611487616:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848444.958586:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848444.958607:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc1b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4c0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.958729:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc1bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.958745:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc1bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.958757:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc1bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.958784:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc1c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.958792:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.958800:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959153:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc1c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959172:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959179:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848444.959190:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787848444.959297:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc1bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959306:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc1bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959314:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc1bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959321:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848444.959326:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc1bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959336:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc1bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959350:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:1.0:1787848444.959353:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848444.959359:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc1bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959366:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc1bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959380:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959392:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc1c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959398:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959404:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ec00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848444.959407:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959414:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc1c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959422:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff43951300) 00010000:00010000:1.0:1787848444.959425:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848444.959428:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc1c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959434:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc1c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959474:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fa00/0x9aeb41e0543cc1b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c0 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959489:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c0 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848444.959498:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:1.0:1787848444.959500:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787848444.959508:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f200, rc 0) 00000100:00100000:1.0:1787848444.959742:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11547:x1874694611487616:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1178us (1412us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787848444.959751:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 189 00000100:00100000:3.0:1787848444.965479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848444.967272:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611487744 00000100:00100000:2.0:1787848444.967290:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611487744 00000100:00100000:2.0:1787848444.967422:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 190 00000100:00100000:2.0:1787848444.967434:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11547:x1874694611487744:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:2.0:1787848444.967520:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.967539:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.967551:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.967579:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.967602:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.967608:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.967615:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848444.967620:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.967628:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.967684:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:2.0:1787848444.967688:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787848444.967694:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848444.967701:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848444.967807:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11547:x1874694611487744:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 375us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848444.967816:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 190 00000100:00100000:3.0:1787848444.974482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848444.974577:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611488000 00000100:00100000:1.0:1787848444.974590:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611488000 00000100:00100000:1.0:1787848444.974693:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:1.0:1787848444.974705:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11547:x1874694611488000:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848444.974971:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:11547:x1874694611488000:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 268us (498us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787848444.974980:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 51 00010000:00010000:2.0:1787848444.975845:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848445.015151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848445.015518:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611488256 00000100:00100000:0.0:1787848445.015527:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611488256 00000100:00100000:0.0:1787848445.015587:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 191 00000100:00100000:0.0:1787848445.015599:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80784b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:11080:x1874694611488256:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787848445.015625:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848445.015680:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1de lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4c7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.015791:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.015807:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc1c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c0 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.015831:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.015867:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c0 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.015881:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc1c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c0 expref: 28 pid: 5842 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848445.015896:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791d03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874694631411456:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848445.017526:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431f3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787848445.019361:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.019445:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611488384 00000100:00100000:2.0:1787848445.019454:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611488384 00010000:00010000:2.0:1787848445.019504:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc1c9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c0 expref: 29 pid: 5842 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848445.019564:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00100000:2.0:1787848445.019574:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80787c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:2352:x1874694611488384:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848445.019588:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848445.019595:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc1c9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c0 expref: 29 pid: 5842 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.019608:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc1c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c0 expref: 29 pid: 5842 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.019629:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:2.0:1787848445.019635:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.019681:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.019689:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.019708:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848445.019752:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80787c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:2352:x1874694611488384:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 180us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848445.019772:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 72 00010000:00010000:0.0:1787848445.020813:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc1c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c0 expref: 28 pid: 5842 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848445.020833:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791d03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874694631411456:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848445.020859:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.020868:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.020873:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848445.020892:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787848445.021100:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc1de lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c7 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.021136:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c7 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.021145:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:0.0:1787848445.021148:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787848445.021151:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c000, rc 0) 00000100:00100000:0.0:1787848445.021212:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80784b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:11080:x1874694611488256:12345-192.168.201.26@tcp:101:bash.0 Request processed in 5616us (6070us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787848445.021220:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 191 00000100:00100000:1.0:1787848445.032803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.032902:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611488640 00000100:00100000:2.0:1787848445.032921:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611488640 00000100:00100000:2.0:1787848445.032985:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 192 00000100:00100000:2.0:1787848445.032996:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80785680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:11080:x1874694611488640:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:2.0:1787848445.033285:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.033302:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.033314:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787848445.033371:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787848445.033396:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091b957ea reply state 000000009cff31ec transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848445.034006:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787848445.035263:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787848445.035981:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80785680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:11080:x1874694611488640:12345-192.168.201.26@tcp:36:bash.0 Request processed in 2972us (3175us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787848445.035993:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 192 00000020:00080000:2.0:1787848445.035999:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787848445.039455:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.039474:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.039480:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.039486:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848445.039499:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.039507:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.039525:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:0.0:1787848445.039527:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848445.039532:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.039554:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc1f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848445.043147:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.043241:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611488768 00000100:00100000:2.0:1787848445.043251:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611488768 00000100:00100000:2.0:1787848445.043312:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 193 00000100:00100000:2.0:1787848445.043322:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7956c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+31:11080:x1874694611488768:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787848445.043346:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848445.043368:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc1fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4ce expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.043428:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc1fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ce expref: 32 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.043464:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc1fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ce expref: 32 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.043484:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:2.0:1787848445.043487:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787848445.043491:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664000, rc 0) 00000100:00100000:2.0:1787848445.043550:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7956c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:11080:x1874694611488768:12345-192.168.201.26@tcp:101:bash.0 Request processed in 229us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848445.043558:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 193 00000100:00100000:3.0:1787848445.050711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848445.050859:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611488896 00000100:00100000:1.0:1787848445.050868:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611488896 00000100:00100000:1.0:1787848445.050927:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:1.0:1787848445.050937:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:11080:x1874694611488896:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787848445.050955:0:11455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848445.050975:0:11455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc201 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4d5 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787848445.051001:0:11455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9066fb, atime: 0x6a9066f9, ctime: 0x6a9066fb, blocks: 0xb 00010000:00010000:1.0:1787848445.051032:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787848445.051037:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848445.051046:0:11455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc201 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4d5 expref: 8 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848445.051090:0:11455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc201 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4d5 expref: 8 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848445.051104:0:11455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42ec00, rc 0) 00000100:00100000:1.0:1787848445.051168:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:11080:x1874694611488896:12345-192.168.201.26@tcp:101:bash.0 Request processed in 232us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848445.051176:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:3.0:1787848445.054477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.054688:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611489024 00000100:00100000:2.0:1787848445.054698:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611489024 00002000:00010000:2.0:1787848445.054744:0:6697:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787848445.054750:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff78fab840 with x1874694611489024 ext(0->18446744073709551615) 00002000:00010000:2.0:1787848445.054773:0:6697:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff78fab840. 00000100:00100000:2.0:1787848445.054802:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:2.0:1787848445.054812:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2351:x1874694611489024:12345-192.168.201.26@tcp:10:bash.0 00002000:00010000:2.0:1787848445.055096:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787848445.055100:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787848443 -> 1787848445 00002000:00010000:2.0:1787848445.055103:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787848441 -> 1787848441 00002000:00010000:2.0:1787848445.055106:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787848443 -> 1787848445 00002000:00010000:2.0:1787848445.055109:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787848445.055167:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2351:x1874694611489024:12345-192.168.201.26@tcp:10:bash.0 Request processed in 356us (698us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787848445.055175:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00002000:00010000:2.0:1787848445.055179:0:6697:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787848445.055195:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff78fab840 with x1874694611489024 ext(0->18446744073709551615) 00002000:00010000:2.0:1787848445.055201:0:6697:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff78fab840. 00000100:00100000:0.0:1787848445.187670:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.187842:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611489152 00000100:00100000:2.0:1787848445.187854:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611489152 00000100:00100000:2.0:1787848445.187921:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 194 00000100:00100000:2.0:1787848445.187933:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:11561:x1874694611489152:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:2.0:1787848445.188017:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc208 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188035:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188048:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188185:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc20f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188195:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc20f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188201:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc20f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188773:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188785:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188793:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787848445.188839:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188851:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188857:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc208 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188864:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188869:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848445.188874:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188881:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc208 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188893:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:2.0:1787848445.188895:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848445.188900:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188906:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188919:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc20f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188925:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc20f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188937:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc20f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188942:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848445.188945:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc20f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188952:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc20f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188960:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff53a89c00) 00010000:00010000:2.0:1787848445.188963:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848445.188966:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc20f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188971:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc20f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188986:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188992:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc216 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.188998:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.189002:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848445.189005:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.189021:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.189029:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:2.0:1787848445.189031:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848445.189036:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc216 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.189041:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848445.189965:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:11561:x1874694611489152:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 2027us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848445.189977:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 194 00000100:00100000:3.0:1787848445.242669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.242933:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611489408 00000100:00100000:2.0:1787848445.242943:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611489408 00000100:00100000:2.0:1787848445.243004:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 195 00000100:00100000:2.0:1787848445.243015:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+32:11564:x1874694611489408:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848445.243036:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848445.243068:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc21d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4dc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243148:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc224 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243163:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243174:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243205:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc22b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243213:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc22b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243220:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc22b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243540:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243550:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243556:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848445.243566:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787848445.243682:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243690:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc224 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243697:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243703:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848445.243707:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243725:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc224 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243737:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:2.0:1787848445.243740:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848445.243745:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243751:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243774:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc22b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243780:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc22b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243786:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc22b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243791:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848445.243794:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc22b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243800:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc22b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243807:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff53a89c00) 00010000:00010000:2.0:1787848445.243810:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848445.243812:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc22b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243828:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc22b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243867:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc21d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4dc expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243881:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4dc expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.243888:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:2.0:1787848445.243891:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787848445.243894:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665800, rc 0) 00000100:00100000:2.0:1787848445.243960:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:11564:x1874694611489408:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 947us (1327us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787848445.243967:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 195 00000100:00100000:3.0:1787848445.251987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848445.252114:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611489536 00000100:00100000:0.0:1787848445.252127:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611489536 00000100:00100000:0.0:1787848445.252201:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 196 00000100:00100000:0.0:1787848445.252212:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:11564:x1874694611489536:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:0.0:1787848445.252453:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.252470:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c7 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.252481:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.252522:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c7 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.252550:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c7 expref: 34 pid: 5844 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848445.252567:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791d3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631411584:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848445.252708:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431f3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787848445.256607:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.256809:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791d3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631411584:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848445.256843:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848445.256917:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611489792 00000100:00100000:1.0:1787848445.256924:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611489792 00000100:00100000:1.0:1787848445.256980:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:1.0:1787848445.256990:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:5593:x1874694611489792:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787848445.257506:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+36:5593:x1874694611489792:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 516us (907us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787848445.257514:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:3.0:1787848445.260741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.260912:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611489920 00000100:00100000:2.0:1787848445.260922:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611489920 00010000:00010000:2.0:1787848445.260966:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c7 expref: 36 pid: 5844 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848445.261009:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 73 00000100:00100000:2.0:1787848445.261020:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78faad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+36:2352:x1874694611489920:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848445.261054:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848445.261061:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c7 expref: 36 pid: 5844 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.261085:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c7 expref: 36 pid: 5844 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.261110:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc1e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4c7 expref: 36 pid: 5844 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.261129:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:2.0:1787848445.261133:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.261144:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.261151:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.261188:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848445.261247:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78faad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:2352:x1874694611489920:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 229us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848445.261255:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 73 00010000:00010000:3.0:1787848445.261538:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.261548:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.261577:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.261592:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.261599:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.261606:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848445.261611:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.261618:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.261629:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:3.0:1787848445.261632:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787848445.261635:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.261680:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc240 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848445.261721:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:11564:x1874694611489536:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 9510us (9748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848445.261729:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 196 00000100:00100000:3.0:1787848445.265746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848445.265950:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611490176 00000100:00100000:1.0:1787848445.265961:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611490176 00000100:00100000:1.0:1787848445.266024:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:1.0:1787848445.266035:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+34:11564:x1874694611490176:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848445.266294:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:11564:x1874694611490176:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 260us (558us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787848445.266303:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:1.0:1787848445.484684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.484816:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611490432 00000100:00100000:2.0:1787848445.484830:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611490432 00000100:00100000:2.0:1787848445.484900:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 197 00000100:00100000:2.0:1787848445.484911:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+35:11575:x1874694611490432:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:2.0:1787848445.484962:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848445.484984:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc247 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4e3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485078:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc24e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485094:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc24e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485105:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc24e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485119:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc255 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485127:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485134:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485676:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc25c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485688:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc25c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485696:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc25c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848445.485706:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787848445.485831:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc24e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485840:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc24e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485847:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc24e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485853:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848445.485858:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc24e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485867:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc24e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485879:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:2.0:1787848445.485882:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848445.485887:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc24e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485893:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc24e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485906:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485913:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc255 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485918:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485924:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848445.485933:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485940:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc255 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485947:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff53a89c00) 00010000:00010000:2.0:1787848445.485950:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848445.485953:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc255 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.485959:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc255 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.486002:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc247 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4e3 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.486017:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc25c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4e3 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.486024:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:2.0:1787848445.486026:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787848445.486029:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665a00, rc 0) 00000100:00100000:2.0:1787848445.486524:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+37:11575:x1874694611490432:12345-192.168.201.26@tcp:101:cat.0 Request processed in 1612us (1848us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787848445.486534:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 197 00000040:00080000:0.0:1787848445.489555:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787848445.489578:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787848445.489619:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787848445.489626:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787848445.495558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848445.495777:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611490688 00000100:00100000:1.0:1787848445.495801:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611490688 00000100:00100000:1.0:1787848445.495873:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:1.0:1787848445.495884:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+37:11575:x1874694611490688:12345-192.168.201.26@tcp:35:cat.0 00000100:00100000:1.0:1787848445.496158:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:11575:x1874694611490688:12345-192.168.201.26@tcp:35:cat.0 Request processed in 276us (610us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787848445.496167:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:3.0:1787848445.540685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.540953:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611490944 00000100:00100000:2.0:1787848445.540965:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611490944 00000100:00100000:2.0:1787848445.541030:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 198 00000100:00100000:2.0:1787848445.541043:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79298f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:11576:x1874694611490944:12345-192.168.201.26@tcp:36:rm.0 00010000:00010000:2.0:1787848445.541153:0:7097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787848445.541187:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc25c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4e3 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.541210:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4dc expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.541223:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc1fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ce expref: 36 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.541233:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff43951a00) 00010000:00010000:2.0:1787848445.541245:0:7097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848445.541266:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc26a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.541280:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc26a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.541290:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc26a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.541306:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc271 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.541313:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.541320:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.541750:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc278 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.541771:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc278 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.541780:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc278 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787848445.542487:0:7097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1787848445.542498:0:7097:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394453857493ns, next at 395453854829ns, rc = 0 00010000:00010000:2.0:1787848445.542562:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc27f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542574:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc27f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542583:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc27f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542590:0:7097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc27f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542596:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc27f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542602:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc27f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542623:0:7097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787848445.542677:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc278 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542692:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc278 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542698:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc278 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542705:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848445.542710:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc278 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542718:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc278 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542729:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:2.0:1787848445.542733:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787848445.542738:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc278 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542745:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc278 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542776:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc26a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542784:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc26a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542791:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc26a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542796:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848445.542805:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc26a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542812:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc26a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542822:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:2.0:1787848445.542825:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848445.542828:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc26a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.542836:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc26a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787848445.542848:0:7097:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d04fcf99 reply state 0000000000c0b3aa transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848445.542858:0:7097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787848445.542960:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79298f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+37:11576:x1874694611490944:12345-192.168.201.26@tcp:36:rm.0 Request processed in 1916us (2321us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787848445.542971:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 198 00010000:00010000:0.0:1787848445.543389:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848445.543398:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc27f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.543419:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848445.543423:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc27f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.543431:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc27f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.543443:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:0.0:1787848445.543446:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787848445.543449:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc27f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.543455:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc27f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.543472:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848445.543474:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848445.543476:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848445.550677:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.550696:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc271 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.550704:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc271 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.550711:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848445.550717:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc271 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.550739:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc271 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.550770:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff53a89c00) 00010000:00010000:2.0:1787848445.550774:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848445.550780:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc271 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.550787:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc271 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848445.641153:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.641472:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611491200 00000100:00100000:2.0:1787848445.641483:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611491200 00000100:00100000:2.0:1787848445.641552:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 199 00000100:00100000:2.0:1787848445.641562:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5317de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+36:11582:x1874694611491200:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787848445.641592:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848445.641619:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc286 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4ea expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.641823:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc28d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.641839:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc28d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.641851:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc28d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.641866:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc294 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.641888:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.641894:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787848445.642562:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787848445.642801:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc29b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.642813:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc29b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.642821:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc29b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.642859:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc28d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.642866:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc28d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.642873:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc28d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.642880:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848445.642885:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc28d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.642893:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc28d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.642917:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:2.0:1787848445.642920:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848445.642925:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc28d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.642931:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc28d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787848445.642945:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed08727c reply state 000000006c36001e transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848445.642954:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787848445.642983:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc286 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ea expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.642998:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc29b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ea expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.643005:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:2.0:1787848445.643007:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787848445.643009:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664000, rc 0) 00000100:00100000:2.0:1787848445.643095:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5317de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+39:11582:x1874694611491200:12345-192.168.201.26@tcp:101:bash.0 Request processed in 1533us (1952us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787848445.643104:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 199 00000100:00100000:3.0:1787848445.647524:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:0.0:1787848445.647902:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.647919:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc294 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.647927:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc294 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.647951:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848445.647958:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc294 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.647966:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc294 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.647983:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff53a89c00) 00010000:00010000:0.0:1787848445.647986:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848445.647991:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc294 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848445.647997:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc294 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848445.648122:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611491328 00000100:00100000:2.0:1787848445.648135:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611491328 00000100:00100000:2.0:1787848445.648208:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:2.0:1787848445.648219:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611491328:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787848445.648244:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848445.648262:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b587da93/0x9aeb41e0543cc2a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4f1 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787848445.648297:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787848445.648316:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1787848445.648321:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848445.648330:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b587da93/0x9aeb41e0543cc2a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f1 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.648347:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b587da93/0x9aeb41e0543cc2a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f1 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.648359:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665800, rc 0) 00000100:00100000:2.0:1787848445.648427:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2352:x1874694611491328:12345-192.168.201.26@tcp:101:bash.0 Request processed in 210us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848445.648435:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00080000:3.0:1787848445.649549:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787848445.653748:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.653852:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611491456 00000100:00100000:2.0:1787848445.653863:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611491456 00000100:00100000:2.0:1787848445.653912:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:2.0:1787848445.653921:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:11582:x1874694611491456:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787848445.653939:0:11455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848445.653956:0:11455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4f8 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.653991:0:11455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b587da93/0x9aeb41e0543cc2a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f1 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.654011:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848445.654016:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848445.654021:0:11455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 7 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.654072:0:11455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b587da93/0x9aeb41e0543cc2a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f1 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.654085:0:11455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b587da93/0x9aeb41e0543cc2a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f1 expref: 7 pid: 6689 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848445.654100:0:11455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79417480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11455:1874694631411712:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848445.654199:0:11455:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff460eb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848445.661417:0:11455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79417480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11455:1874694631411712:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848445.661456:0:11455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 7 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.661478:0:11455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665a00, rc 0) 00000100:00100000:2.0:1787848445.661540:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:11582:x1874694611491456:12345-192.168.201.26@tcp:101:bash.0 Request processed in 7619us (7803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848445.661550:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:0.0:1787848445.668845:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.668958:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611491584 00000100:00100000:2.0:1787848445.668970:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611491584 00010000:00010000:2.0:1787848445.669016:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b587da93/0x9aeb41e0543cc2a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f1 expref: 7 pid: 6689 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848445.669082:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00100000:2.0:1787848445.669093:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2353:x1874694611491584:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848445.669109:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848445.669133:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b587da93/0x9aeb41e0543cc2a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f1 expref: 7 pid: 6689 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.669149:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b587da93/0x9aeb41e0543cc2a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f1 expref: 7 pid: 6689 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.669172:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b587da93/0x9aeb41e0543cc2a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f1 expref: 7 pid: 6689 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.669189:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848445.669194:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848445.669203:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 6 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.669215:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 6 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.669254:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 6 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848445.669283:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79417480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1874694631411840:192.168.201.26@tcp:105: 00000100:00100000:2.0:1787848445.669394:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff460eb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848445.677889:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79417480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1874694631411840:192.168.201.26@tcp:105: 00010000:00010000:2.0:1787848445.677918:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848445.677977:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2353:x1874694611491584:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 8885us (9144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848445.677990:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00100000:3.0:1787848445.682473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848445.682568:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611491840 00000100:00100000:1.0:1787848445.682576:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611491840 00000100:00100000:1.0:1787848445.682633:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:1.0:1787848445.682678:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+38:11582:x1874694611491840:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:1.0:1787848445.683011:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+39:11582:x1874694611491840:12345-192.168.201.26@tcp:35:bash.0 Request processed in 369us (546us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787848445.683019:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:0.0:1787848445.968066:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.968294:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611491968 00000100:00100000:2.0:1787848445.968305:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611491968 00000100:00100000:2.0:1787848445.968371:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 200 00000100:00100000:2.0:1787848445.968382:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f430780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+39:11598:x1874694611491968:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848445.968409:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848445.968431:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc2b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb4ff expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.968497:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc2be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.968513:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.968525:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848445.968585:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787848445.968589:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787848445.968612:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.968682:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc2b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ff expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.968718:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc2be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ff expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.968726:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:2.0:1787848445.968856:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787848445.968861:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664200, rc 0) 00000100:00100000:2.0:1787848445.968937:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f430780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+40:11598:x1874694611491968:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 556us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848445.968944:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 200 00000100:00100000:0.0:1787848445.981615:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848445.981757:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611492224 00000100:00100000:3.0:1787848445.981767:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611492224 00000100:00100000:3.0:1787848445.981820:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 201 00000100:00100000:3.0:1787848445.981829:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f4330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+40:11598:x1874694611492224:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848445.981850:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848445.981871:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc2c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb506 expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.982001:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc2cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.982017:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc2cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.982030:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc2cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848445.982060:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787848445.982188:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc2c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb506 expref: 43 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.982208:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc2cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb506 expref: 42 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848445.982217:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:3.0:1787848445.982220:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848445.982223:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237800, rc 0) 00000100:00100000:3.0:1787848445.982283:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f4330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+42:11598:x1874694611492224:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 455us (678us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787848445.982300:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 201 00000100:00100000:0.0:1787848445.990081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848445.990403:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611492480 00000100:00100000:2.0:1787848445.990416:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611492480 00000100:00100000:2.0:1787848445.990477:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 202 00000100:00100000:2.0:1787848445.990488:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f432940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+42:11598:x1874694611492480:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848445.990515:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848445.990535:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc2da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb50d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.990686:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc2e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.990702:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.990714:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848445.990893:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787848445.991050:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc2da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb50d expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.991184:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc2e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb50d expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848445.991193:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:2.0:1787848445.991196:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787848445.991200:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665200, rc 0) 00000100:00100000:2.0:1787848445.991277:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f432940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+44:11598:x1874694611492480:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 790us (1206us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787848445.991285:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 202 00010000:00010000:2.0:1787848445.999923:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848446.000884:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848446.000934:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848446.001021:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611492736 00000100:00100000:2.0:1787848446.001030:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611492736 00000100:00100000:2.0:1787848446.001124:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:2.0:1787848446.001135:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f9fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+44:2351:x1874694611492736:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848446.001151:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848446.001176:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc2cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb506 expref: 44 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.001196:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:2.0:1787848446.001202:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848446.001258:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f9fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+43:2351:x1874694611492736:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 125us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848446.001266:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00080000:0.0:1787848446.001560:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848446.002006:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611492608 00000100:00100000:3.0:1787848446.002013:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611492608 00000100:00100000:3.0:1787848446.002065:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:3.0:1787848446.002073:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+6:2351:x1874694611492608:12345-192.168.201.26@tcp:1:lfs.0 00010000:00010000:3.0:1787848446.002118:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.002138:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 6 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.002149:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848446.002153:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787848446.002157:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.002192:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 6 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.002206:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 6 pid: 11455 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848446.002219:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f0230c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1874694631411968:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848446.002340:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848446.012281:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848446.012371:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611492864 00000100:00100000:1.0:1787848446.012383:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611492864 00002000:00100000:1.0:1787848446.012450:0:6695:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93ff792a6940 x1874694611492864/t0(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:152/0 lens 504/0 e 0 to 0 dl 1787848457 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787848446.012462:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff792a6940 with x1874694611492864 ext(0->8) 00010000:00010000:1.0:1787848446.012471:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 7 pid: 11455 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.012487:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 7 pid: 11455 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787848446.012494:0:6695:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ff792a6940 00000100:00100000:1.0:1787848446.012528:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:1.0:1787848446.012555:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611492864:12345-192.168.201.26@tcp:4:lfs.0 00000100:00100000:3.0:1787848446.012941:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f0230c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1874694631411968:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848446.012976:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848446.014791:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2352:x1874694611492864:12345-192.168.201.26@tcp:4:lfs.0 Request processed in 2229us (2510us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787848446.014805:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 3 00002000:00100000:1.0:1787848446.014818:0:6695:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93ff792a6940 x1874694611492864/t4294967308(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:152/0 lens 504/448 e 0 to 0 dl 1787848457 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787848446.014828:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff792a6940 with x1874694611492864 ext(0->8) 00010000:00010000:1.0:1787848446.014841:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 9 pid: 11455 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.014859:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 9 pid: 11455 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787848446.014865:0:6695:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ff792a6940 00000100:00100000:1.0:1787848446.019531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848446.019636:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611492992 00000100:00100000:0.0:1787848446.019666:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611492992 00010000:00010000:0.0:1787848446.019850:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 9 pid: 11455 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848446.020422:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 75 00000100:00100000:0.0:1787848446.020435:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2353:x1874694611492992:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848446.020452:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787848446.020473:0:8522:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787848446.020476:0:8522:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787848446 00002000:00010000:0.0:1787848446.020477:0:8522:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787848446 00002000:00010000:0.0:1787848446.020479:0:8522:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787848446 00010000:00010000:0.0:1787848446.020486:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 9 pid: 11455 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.020500:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 9 pid: 11455 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.020522:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000762a16d3/0x9aeb41e0543cc2b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4f8 expref: 9 pid: 11455 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.020539:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848446.020544:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848446.020549:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.020558:0:8522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.020592:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848446.020702:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2353:x1874694611492992:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 270us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848446.020710:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 75 00010000:00010000:3.0:1787848446.021467:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.021481:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.021514:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.021524:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.021531:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.021538:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848446.021543:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.021551:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.021564:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.021582:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036473462/0x9aeb41e0543cc2ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848446.021698:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2351:x1874694611492608:12345-192.168.201.26@tcp:1:lfs.0 Request processed in 19624us (20762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848446.021708:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:1.0:1787848446.026570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848446.026681:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611493248 00000100:00100000:3.0:1787848446.026691:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611493248 00000100:00100000:2.0:1787848446.026957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:2.0:1787848446.026988:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff47b4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+43:11598:x1874694611493248:12345-192.168.201.26@tcp:35:lfs.0 00000004:00010000:2.0:1787848446.030008:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc2e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb50d expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787848446.030388:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787848446.030568:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787848446.031524:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787848446.031600:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.031618:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc29b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ea expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.031627:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.033258:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc29b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ea expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.033282:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc29b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ea expref: 47 pid: 5843 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848446.033298:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1874694631412096:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848446.033514:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431f33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848446.036443:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1874694631412096:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848446.036478:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848446.039930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848446.041380:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611493376 00000100:00100000:2.0:1787848446.041395:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611493376 00010000:00010000:2.0:1787848446.041455:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc29b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ea expref: 48 pid: 5843 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848446.041502:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 76 00000100:00100000:2.0:1787848446.041512:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+48:2351:x1874694611493376:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848446.041529:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848446.041536:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc29b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ea expref: 48 pid: 5843 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.041549:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc29b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ea expref: 48 pid: 5843 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.041590:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc29b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ea expref: 48 pid: 5843 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.041609:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:2.0:1787848446.041613:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.041623:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.041631:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.041966:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787848446.042099:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.042107:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787848446.042239:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787848446.042428:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787848446.042528:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874694631412224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787848446.042586:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848446.042635:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431f3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787848446.042955:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631412224 00000100:00100000:3.0:1787848446.042961:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631412224 00000100:00100000:3.0:1787848446.043017:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787848446.043025:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874694631412224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787848446.043113:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874694631412224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848446.043120:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787848446.043329:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+49:2351:x1874694611493376:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 1815us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848446.043341:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 76 00000100:00080000:0.0:1787848446.043425:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787848446.043466:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874694631412224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787848446.046343:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787848446.046568:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874694631412352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787848446.046899:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848446.046996:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431f33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848446.049555:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631412352 00000100:00100000:3.0:1787848446.049571:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631412352 00000100:00100000:0.0:1787848446.050004:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787848446.050017:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874694631412352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787848446.050331:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1874694631412352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 317us (3432us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787848446.050340:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787848446.050418:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874694631412352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787848446.050490:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787848446.050540:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.050551:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.050557:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.050576:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848446.050581:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.050588:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.050604:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:1.0:1787848446.050607:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787848446.050611:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.050616:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc2f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787848446.050868:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787848446.050961:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1787848446.050972:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394962331403ns, next at 395962329061ns, rc = 0 00000001:00080000:1.0:1787848446.050979:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787848446.051008:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:1.0:1787848446.051011:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787848446.051017:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc2e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb50d expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848446.051104:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff47b4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+50:11598:x1874694611493248:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 24121us (24548us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787848446.051113:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 56 00000020:00080000:1.0:1787848446.051116:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787848446.054899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848446.055003:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611493504 00000100:00100000:3.0:1787848446.055014:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611493504 00000100:00100000:3.0:1787848446.055199:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 203 00000100:00100000:3.0:1787848446.055211:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+50:11598:x1874694611493504:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848446.055238:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848446.055264:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc2fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb514 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.055327:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc2fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb514 expref: 51 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.055356:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc2fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb514 expref: 51 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.055378:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:3.0:1787848446.055382:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787848446.055386:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236600, rc 0) 00000100:00100000:3.0:1787848446.055483:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+51:11598:x1874694611493504:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 275us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848446.055490:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 203 00000100:00100000:1.0:1787848446.059315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848446.059454:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611493760 00000100:00100000:3.0:1787848446.059465:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611493760 00000100:00100000:3.0:1787848446.059522:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:3.0:1787848446.059532:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+51:11598:x1874694611493760:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:3.0:1787848446.060023:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+52:11598:x1874694611493760:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 491us (718us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787848446.060039:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:3.0:1787848446.195846:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848446.196014:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611493888 00000100:00100000:2.0:1787848446.196025:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611493888 00000100:00100000:2.0:1787848446.196110:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 204 00000100:00100000:2.0:1787848446.196120:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f0230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+52:11608:x1874694611493888:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:2.0:1787848446.196222:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc304 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196241:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196254:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196279:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc30b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196286:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc30b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196293:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc30b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196400:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196409:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196415:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787848446.196458:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196471:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196478:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc304 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196484:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc304 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196490:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848446.196494:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc304 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196507:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc304 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196519:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:2.0:1787848446.196522:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848446.196527:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc304 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196534:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc304 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196549:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc30b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196556:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc30b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196561:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc30b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196566:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848446.196568:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc30b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196573:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc30b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196579:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff53a89c00) 00010000:00010000:2.0:1787848446.196582:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848446.196584:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc30b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196599:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc30b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196613:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196618:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc312 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196622:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196627:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848446.196629:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.196634:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc312 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.197260:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:2.0:1787848446.197263:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848446.197268:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc312 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.197274:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc312 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848446.197377:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f0230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+52:11608:x1874694611493888:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 1256us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848446.197386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 204 00000100:00100000:1.0:1787848446.240905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848446.241009:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611494144 00000100:00100000:0.0:1787848446.241020:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611494144 00000100:00100000:0.0:1787848446.241095:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 205 00000100:00100000:0.0:1787848446.241105:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+52:11611:x1874694611494144:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848446.241125:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848446.241146:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc319 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb51b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241224:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc320 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241240:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc320 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241254:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc320 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241270:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc327 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241296:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241303:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241759:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc32e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241770:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241778:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848446.241788:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787848446.241890:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc320 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241898:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc320 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241904:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc320 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241911:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148ca00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848446.241916:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc320 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241923:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc320 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241949:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:0.0:1787848446.241952:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848446.241956:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc320 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241962:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc320 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241976:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241982:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc327 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241986:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.241991:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848446.241994:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.242000:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc327 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.242007:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff48373600) 00010000:00010000:0.0:1787848446.242009:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848446.242011:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc327 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.242015:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc327 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.242193:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc319 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb51b expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.242210:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc32e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb51b expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.242217:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:0.0:1787848446.242220:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848446.242222:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148d400, rc 0) 00000100:00100000:0.0:1787848446.242333:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:11611:x1874694611494144:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1228us (1437us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787848446.242341:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 205 00000100:00100000:3.0:1787848446.246363:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848446.246435:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611494272 00000100:00100000:0.0:1787848446.246447:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611494272 00000100:00100000:0.0:1787848446.246517:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 206 00000100:00100000:0.0:1787848446.246528:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f0212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:11611:x1874694611494272:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:0.0:1787848446.246607:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc33c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.246626:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.246674:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.246705:0:9224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.246730:0:9224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc33c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.246737:0:9224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc33c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.246753:0:9224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848446.246758:0:9224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc33c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.246766:0:9224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc33c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.246779:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:0.0:1787848446.246782:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787848446.246787:0:9224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc33c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.246794:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc33c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848446.247500:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f0212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:11611:x1874694611494272:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 969us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848446.247509:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 206 00000100:00100000:3.0:1787848446.249995:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848446.250163:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611494528 00000100:00100000:1.0:1787848446.250173:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611494528 00000100:00100000:1.0:1787848446.250240:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:1.0:1787848446.250252:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f022580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+54:11611:x1874694611494528:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848446.250492:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f022580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:11611:x1874694611494528:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 243us (505us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787848446.250500:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:1.0:1787848446.336773:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848446.336944:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611494784 00000100:00100000:2.0:1787848446.336958:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611494784 00000100:00100000:2.0:1787848446.337027:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 207 00000100:00100000:2.0:1787848446.337038:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:11621:x1874694611494784:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787848446.337177:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848446.337181:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787848446.337216:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664200/0x9aeb41e0543cc2be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4ff expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.337238:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:2.0:1787848446.337243:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848446.337257:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc343 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb522 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.337367:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.337383:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc32e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb51b expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.337391:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.337438:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc32e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb51b expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.337453:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc32e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb51b expref: 55 pid: 5844 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848446.337494:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79414b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631412480:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848446.337837:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe410b2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787848446.343751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848446.343841:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611494912 00000100:00100000:1.0:1787848446.343852:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611494912 00010000:00010000:1.0:1787848446.343904:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc32e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb51b expref: 56 pid: 5844 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848446.343949:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00100000:1.0:1787848446.343960:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+56:2351:x1874694611494912:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848446.343979:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848446.343986:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc32e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb51b expref: 56 pid: 5844 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.344001:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc32e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb51b expref: 56 pid: 5844 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.344027:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:1.0:1787848446.344044:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.344077:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.344084:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.344104:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848446.344167:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+56:2351:x1874694611494912:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 210us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848446.344176:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 77 00010000:00010000:3.0:1787848446.344605:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc32e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb51b expref: 55 pid: 5844 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848446.344627:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79414b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631412480:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848446.344667:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.344688:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.344695:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848446.344717:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787848446.344958:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc343 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb522 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.344980:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb522 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.344989:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:3.0:1787848446.344993:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787848446.344996:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664000, rc 0) 00000100:00100000:3.0:1787848446.345158:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:11621:x1874694611494784:12345-192.168.201.26@tcp:101:bash.0 Request processed in 8122us (8402us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787848446.345166:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 207 00000100:00100000:3.0:1787848446.348454:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848446.348594:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611495168 00000100:00100000:2.0:1787848446.348610:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611495168 00000100:00100000:2.0:1787848446.348729:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 208 00000100:00100000:2.0:1787848446.348749:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f021680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+55:11621:x1874694611495168:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:2.0:1787848446.349162:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc358 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.349183:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.349198:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787848446.349260:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787848446.349288:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009892848e reply state 00000000a8226ae7 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848446.349297:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787848446.349411:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f021680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+58:11621:x1874694611495168:12345-192.168.201.26@tcp:36:bash.0 Request processed in 659us (959us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787848446.349419:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 208 00000020:00080000:2.0:1787848446.349423:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787848446.353011:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.353040:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc358 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.353053:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc358 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.353081:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848446.353087:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc358 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.353094:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc358 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.353116:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:3.0:1787848446.353119:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848446.353125:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc358 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.353130:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc358 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848446.354254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848446.355273:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611495296 00000100:00100000:0.0:1787848446.355289:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611495296 00000100:00100000:0.0:1787848446.355754:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 209 00000100:00100000:0.0:1787848446.355777:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f020780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+57:11621:x1874694611495296:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787848446.355815:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848446.355868:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc35f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb529 expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.355974:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.355988:0:9224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb522 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.355997:0:9224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.356162:0:9224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb522 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848446.356235:0:9224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb522 expref: 58 pid: 5843 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848446.356253:0:9224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792a5680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631412608:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848446.356433:0:9224:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431f3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787848446.361733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848446.361841:0:9224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792a5680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631412608:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848446.361871:0:9224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848446.361957:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611495424 00000100:00100000:1.0:1787848446.361964:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611495424 00010000:00010000:1.0:1787848446.362008:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb522 expref: 59 pid: 5843 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848446.362188:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 78 00000100:00100000:1.0:1787848446.362199:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79414000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+59:2352:x1874694611495424:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848446.362218:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848446.362226:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb522 expref: 59 pid: 5843 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.362239:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb522 expref: 59 pid: 5843 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.362266:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc34a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb522 expref: 59 pid: 5843 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.362302:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:1.0:1787848446.362308:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.362318:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.362327:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.362363:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848446.362435:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79414000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+58:2352:x1874694611495424:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 239us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848446.362444:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 78 00010000:00010000:3.0:1787848446.362493:0:9224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.362500:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848446.362553:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787848446.362558:0:9224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848446.362584:0:9224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.362632:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc35f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb529 expref: 58 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.362674:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb529 expref: 57 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.362682:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:3.0:1787848446.362684:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848446.362686:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c000, rc 0) 00000100:00100000:3.0:1787848446.362715:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f020780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+57:11621:x1874694611495296:12345-192.168.201.26@tcp:101:bash.0 Request processed in 6950us (8474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848446.362723:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 209 00000100:00100000:1.0:1787848446.366984:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848446.367262:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611495680 00000100:00100000:0.0:1787848446.367272:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611495680 00000100:00100000:0.0:1787848446.367334:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:0.0:1787848446.367345:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+57:11621:x1874694611495680:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:0.0:1787848446.367607:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+58:11621:x1874694611495680:12345-192.168.201.26@tcp:35:bash.0 Request processed in 263us (634us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787848446.367615:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:0.0:1787848446.485549:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848446.485830:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611495808 00000100:00100000:3.0:1787848446.485842:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611495808 00000100:00100000:3.0:1787848446.485907:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 210 00000100:00100000:3.0:1787848446.485918:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+58:11627:x1874694611495808:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848446.485942:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848446.485963:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc36d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb530 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.486032:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cc374 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.486056:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cc374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.486069:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cc374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848446.486138:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787848446.486143:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848446.486166:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cc374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.486207:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc36d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb530 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.486230:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cc374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb530 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.486240:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:3.0:1787848446.486244:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787848446.486247:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236e00, rc 0) 00000100:00100000:3.0:1787848446.486315:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+59:11627:x1874694611495808:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 398us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848446.486323:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 210 00000100:00100000:2.0:1787848446.500177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848446.500316:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611495936 00000100:00100000:3.0:1787848446.500328:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611495936 00000100:00100000:3.0:1787848446.500392:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 211 00000100:00100000:3.0:1787848446.500411:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+59:11627:x1874694611495936:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848446.500435:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848446.500458:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc37b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb537 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500527:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc382 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500560:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500575:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500589:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500595:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500600:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500744:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500753:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500760:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848446.500801:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787848446.500806:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848446.500827:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500838:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500858:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500864:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc382 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500869:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500875:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848446.500879:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500885:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc382 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500896:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:3.0:1787848446.500899:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848446.500903:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc382 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500910:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500923:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500928:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc389 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500932:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500943:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848446.500946:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500951:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500958:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff541a1200) 00010000:00010000:3.0:1787848446.500960:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848446.500963:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc389 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500968:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.500998:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc37b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb537 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.501010:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb537 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.501017:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:3.0:1787848446.501019:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848446.501021:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237000, rc 0) 00000100:00100000:3.0:1787848446.501251:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+60:11627:x1874694611495936:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 849us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848446.501260:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 211 00000100:00100000:1.0:1787848446.512123:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848446.512409:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611496320 00000100:00100000:2.0:1787848446.512435:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611496320 00000100:00100000:2.0:1787848446.512513:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:2.0:1787848446.512524:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+60:2352:x1874694611496320:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848446.512543:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848446.512570:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237000/0x9aeb41e0543cc390 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb537 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.512590:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:2.0:1787848446.512596:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848446.512685:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+59:2352:x1874694611496320:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 164us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848446.512693:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:0.0:1787848446.523818:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848446.523939:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611496192 00000100:00100000:3.0:1787848446.523959:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611496192 00000100:00100000:3.0:1787848446.524029:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 212 00000100:00100000:3.0:1787848446.524040:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+59:11627:x1874694611496192:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787848446.524062:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848446.524083:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc397 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb53e expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.524201:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.524216:0:9224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb529 expref: 60 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.524226:0:9224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.524259:0:9224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb529 expref: 60 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.524273:0:9224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb529 expref: 60 pid: 9224 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848446.524287:0:9224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f022d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631412736:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848446.524372:0:9224:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848446.531583:0:9224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f022d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9224:1874694631412736:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848446.531620:0:9224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848446.533803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848446.533910:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611496448 00000100:00100000:2.0:1787848446.533919:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611496448 00010000:00010000:2.0:1787848446.533962:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb529 expref: 61 pid: 9224 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848446.533996:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:2.0:1787848446.534006:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+61:2351:x1874694611496448:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848446.534023:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848446.534041:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb529 expref: 61 pid: 9224 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.534061:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb529 expref: 61 pid: 9224 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.534088:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb529 expref: 61 pid: 9224 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.534130:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:2.0:1787848446.534135:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.534144:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.534152:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.534187:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848446.534254:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+60:2351:x1874694611496448:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 248us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848446.534262:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 79 00010000:00010000:3.0:1787848446.535488:0:9224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.535510:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848446.535529:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787848446.535720:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc397 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb53e expref: 61 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.535750:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb53e expref: 60 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848446.535766:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:3.0:1787848446.535769:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787848446.535772:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237c00, rc 0) 00000100:00100000:3.0:1787848446.535816:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+60:11627:x1874694611496192:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 11778us (12009us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787848446.535824:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 212 00000100:00100000:2.0:1787848446.548519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848446.548608:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611496704 00000100:00100000:1.0:1787848446.548618:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611496704 00000100:00100000:1.0:1787848446.548700:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:1.0:1787848446.548712:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f9ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+60:11627:x1874694611496704:12345-192.168.201.26@tcp:103:lfs.0 00010000:00010000:1.0:1787848446.548728:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848446.548768:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236600/0x9aeb41e0543cc2fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb514 expref: 60 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848446.548788:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:1.0:1787848446.548793:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848446.548848:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f9ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+59:11627:x1874694611496704:12345-192.168.201.26@tcp:103:lfs.0 Request processed in 139us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848446.548870:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:0.0:1787848446.551316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848446.551389:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611496832 00000100:00100000:2.0:1787848446.551398:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611496832 00000100:00100000:2.0:1787848446.551452:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 213 00000100:00100000:2.0:1787848446.551462:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+59:11627:x1874694611496832:12345-192.168.201.26@tcp:58:lfs.0 00010000:00010000:2.0:1787848446.551575:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.551592:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.551603:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787848446.551880:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787848446.551976:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+59:11627:x1874694611496832:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 515us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848446.551984:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 213 00000100:00100000:3.0:1787848446.553859:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848446.554184:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611496960 00000100:00100000:2.0:1787848446.554195:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611496960 00000100:00100000:2.0:1787848446.554254:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 214 00000100:00100000:2.0:1787848446.554264:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f022d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+59:11627:x1874694611496960:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848446.554282:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848446.554303:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc3b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb545 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.554361:0:7097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.554371:0:7097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc3b3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb545 expref: 60 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.554390:0:7097:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.554417:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc3b3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb545 expref: 60 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.554431:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:2.0:1787848446.554434:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787848446.554437:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc3b3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb545 expref: 60 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848446.554444:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665800, rc 0) 00000100:00100000:2.0:1787848446.554512:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f022d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+60:11627:x1874694611496960:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 250us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848446.554519:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 214 00000100:00100000:0.0:1787848446.660232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848446.660296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848446.660414:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611497216 00000100:00100000:3.0:1787848446.660425:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611497216 00000100:00100000:3.0:1787848446.660516:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00100000:3.0:1787848446.660527:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2354:x1874694611497216:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848446.660608:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2354:x1874694611497216:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 84us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848446.660616:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00100000:0.0:1787848446.661929:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848446.662191:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611497344 00000100:00100000:3.0:1787848446.662199:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611497344 00000100:00100000:3.0:1787848446.662282:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 187 00000100:00100000:3.0:1787848446.662291:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff790ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611497344:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848446.662354:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff790ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2354:x1874694611497344:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 63us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848446.662361:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 187 00000100:00080000:1.0:1787848446.662501:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787848446.662506:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787848446.667821:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611497088 00000100:00100000:2.0:1787848446.667838:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611497088 00000100:00100000:2.0:1787848446.667986:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 311 00000100:00100000:2.0:1787848446.667998:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611497088:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848446.668103:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611497088:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 107us (7805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848446.668112:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 311 00010000:00010000:0.0:1787848447.023832:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787848447.537953:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787848447.537963:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787848447.538031:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787848447.538040:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787848447.538188:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb8e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631412864:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787848447.538314:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431f3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787848447.549732:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb8e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631412864:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787848447.561018:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848447.561429:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611497472 00000100:00100000:2.0:1787848447.561440:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611497472 00000100:00100000:2.0:1787848447.561504:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 215 00000100:00100000:2.0:1787848447.561515:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f023840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+60:11628:x1874694611497472:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787848447.561547:0:5844:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787848447.561679:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f023840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+60:11628:x1874694611497472:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 166us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848447.561686:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 215 00000100:00100000:0.0:1787848447.569395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848447.569547:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611497600 00000100:00100000:3.0:1787848447.569557:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611497600 00000100:00100000:3.0:1787848447.569619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 216 00000100:00100000:3.0:1787848447.569629:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+60:11628:x1874694611497600:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787848447.569912:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc3ba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.569930:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc3ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.569942:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc3ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.569956:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.569962:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.569968:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.569990:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.570017:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.570024:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848447.573684:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787848447.573694:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848447.573714:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573802:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc3ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573811:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc3ba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573820:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc3ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573827:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848447.573831:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc3ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573840:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc3ba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573858:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:3.0:1787848447.573861:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848447.573867:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc3ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573899:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc3ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573920:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573927:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3c1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573932:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573938:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848447.573941:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573947:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3c1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573956:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff93ff541a1200) 00010000:00010000:3.0:1787848447.573958:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848447.573961:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3c1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573967:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3c1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573987:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.573994:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.574006:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.574011:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848447.574014:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.574021:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.574217:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:3.0:1787848447.574221:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848447.574225:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.574231:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848447.574341:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+60:11628:x1874694611497600:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 Request processed in 4709us (4952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848447.574353:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 216 00000100:00100000:0.0:1787848447.586886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848447.586972:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611497856 00000100:00100000:3.0:1787848447.586982:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611497856 00000100:00100000:3.0:1787848447.587051:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 217 00000100:00100000:3.0:1787848447.587061:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+60:11628:x1874694611497856:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787848447.587082:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848447.587104:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb54c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587225:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587241:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587251:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848447.587262:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787848447.587353:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587361:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587368:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587373:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848447.587378:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587385:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587398:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:3.0:1787848447.587401:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787848447.587405:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587436:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc3d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587478:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3cf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb54c expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587489:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:3.0:1787848447.587492:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787848447.587496:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb54c expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.587505:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236c00, rc 0) 00000100:00100000:3.0:1787848447.587567:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+61:11628:x1874694611497856:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 508us (690us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787848447.587574:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 217 00000100:00100000:0.0:1787848447.594993:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848447.597544:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611497984 00000100:00100000:3.0:1787848447.597559:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611497984 00000100:00100000:3.0:1787848447.597635:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 218 00000100:00100000:3.0:1787848447.597676:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+61:11628:x1874694611497984:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787848447.597733:0:7097:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787848447.597860:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+61:11628:x1874694611497984:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 187us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848447.597868:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 218 00000100:00100000:0.0:1787848447.604686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848447.604928:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611498240 00000100:00100000:3.0:1787848447.604938:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611498240 00000100:00100000:3.0:1787848447.604997:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 219 00000100:00100000:3.0:1787848447.605018:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+61:11628:x1874694611498240:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787848447.605045:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848447.605049:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787848447.605076:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236e00/0x9aeb41e0543cc374 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb530 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.605107:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:3.0:1787848447.605113:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848447.605126:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb553 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787848447.612012:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787848447.612258:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc3eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.612275:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.612288:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.612358:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236c00/0x9aeb41e0543cc3e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb553 expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.612398:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc3eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb553 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.612407:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373600) 00010000:00010000:0.0:1787848447.612410:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848447.612413:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c800, rc 0) 00000100:00100000:0.0:1787848447.612486:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+62:11628:x1874694611498240:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 7470us (7853us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787848447.612496:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 219 00000100:00100000:2.0:1787848447.621344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.622154:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611498496 00000100:00100000:0.0:1787848447.622170:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611498496 00000100:00100000:0.0:1787848447.622239:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 220 00000100:00100000:0.0:1787848447.622249:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79414f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+62:11628:x1874694611498496:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787848447.622310:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848447.622337:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c800/0x9aeb41e0543cc3eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb553 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622356:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373600) 00010000:00010000:0.0:1787848447.622368:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787848447.622389:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc3f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622402:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc3f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622412:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc3f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622442:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc400 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5ebbd442 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622450:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc400 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebbd442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622457:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc400 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebbd442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622600:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc3f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622607:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc3f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622614:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc3f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622619:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148ca00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848447.622623:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc3f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622631:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc3f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622729:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:0.0:1787848447.622733:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848447.622737:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc3f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622743:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148ca00/0x9aeb41e0543cc3f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622761:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc400 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebbd442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622767:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc400 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebbd442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622773:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc400 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebbd442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622779:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148d400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848447.622782:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc400 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebbd442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622788:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc400 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebbd442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622796:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5ebbd442 (ffff93ff48373800) 00010000:00010000:0.0:1787848447.622799:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848447.622801:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc400 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5ebbd442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.622807:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148d400/0x9aeb41e0543cc400 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5ebbd442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.622891:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79414f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+61:11628:x1874694611498496:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 642us (1557us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787848447.622898:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 220 00000100:00100000:3.0:1787848447.630993:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.631071:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611498624 00000100:00100000:0.0:1787848447.631082:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611498624 00000100:00100000:0.0:1787848447.631161:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 221 00000100:00100000:0.0:1787848447.631189:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff804d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+61:11628:x1874694611498624:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787848447.631213:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848447.631240:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc407 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb55a expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.631280:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc40e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.631295:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc40e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.631309:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc40e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.631412:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c000/0x9aeb41e0543cc407 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb55a expref: 63 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.631435:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc40e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb55a expref: 62 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.631443:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848447.631446:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787848447.631449:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff4148c600, rc 0) 00000100:00100000:0.0:1787848447.631510:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff804d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+62:11628:x1874694611498624:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 324us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848447.631518:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 221 00000100:00100000:1.0:1787848447.636489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.636568:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611498880 00000100:00100000:0.0:1787848447.636579:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611498880 00000100:00100000:0.0:1787848447.636670:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 222 00000100:00100000:0.0:1787848447.636705:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+62:11628:x1874694611498880:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787848447.636835:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc415 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.636852:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.636863:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787848447.637121:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1787848447.637131:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396548490182ns, next at 397548487907ns, rc = 0 00000004:00010000:0.0:1787848447.637214:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a1cb6ca reply state 00000000e72d88ee transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.637223:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787848447.637311:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+64:11628:x1874694611498880:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 608us (831us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787848447.637319:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 222 00010000:00010000:0.0:1787848447.643188:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.643207:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc415 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.643215:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc415 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.643223:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848447.643227:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc415 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.643253:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc415 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.643272:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848447.643275:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787848447.643281:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc415 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.643288:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc415 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848447.653023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848447.653118:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611499008 00000100:00100000:3.0:1787848447.653132:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611499008 00000100:00100000:3.0:1787848447.653204:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 223 00000100:00100000:3.0:1787848447.653214:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+63:11628:x1874694611499008:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787848447.653242:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848447.653263:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc41c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb561 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.653328:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc41c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb561 expref: 64 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.653343:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc41c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb561 expref: 64 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.653361:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373400) 00010000:00010000:3.0:1787848447.653378:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787848447.653382:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237800, rc 0) 00000100:00100000:3.0:1787848447.653450:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+64:11628:x1874694611499008:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 237us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848447.653457:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 223 00000100:00100000:1.0:1787848447.656607:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.656742:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611499136 00000100:00100000:0.0:1787848447.656754:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611499136 00000100:00100000:0.0:1787848447.656820:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:0.0:1787848447.656830:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2352:x1874694611499136:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787848447.657135:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:2352:x1874694611499136:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 305us (534us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787848447.657144:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:1.0:1787848447.662884:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.662977:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611499392 00000100:00100000:0.0:1787848447.662988:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611499392 00000100:00100000:0.0:1787848447.663071:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:0.0:1787848447.663080:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79649e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+64:11628:x1874694611499392:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787848447.663330:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79649e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+65:11628:x1874694611499392:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 251us (454us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787848447.663339:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:1.0:1787848447.666117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848447.666205:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611499648 00000100:00100000:3.0:1787848447.666215:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611499648 00000100:00100000:3.0:1787848447.666275:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 224 00000100:00100000:3.0:1787848447.666284:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+65:11628:x1874694611499648:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787848447.666393:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+65:11628:x1874694611499648:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 110us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848447.666408:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 224 00000100:00100000:1.0:1787848447.672431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.672685:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611499776 00000100:00100000:0.0:1787848447.672709:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611499776 00000100:00100000:0.0:1787848447.672781:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 225 00000100:00100000:0.0:1787848447.672792:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7964bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+65:11628:x1874694611499776:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787848447.672814:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848447.672834:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc423 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb568 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.672922:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc42a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.672936:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.672946:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848447.672981:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848447.673000:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.673201:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc423 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb568 expref: 67 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.673222:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc42a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb568 expref: 66 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.673230:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848447.673233:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787848447.673236:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030000, rc 0) 00000100:00100000:0.0:1787848447.673296:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7964bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+66:11628:x1874694611499776:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 506us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848447.673309:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 225 00000100:00100000:1.0:1787848447.685326:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848447.685406:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611499904 00000100:00100000:3.0:1787848447.685416:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611499904 00000100:00100000:3.0:1787848447.685476:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:3.0:1787848447.685485:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+10:2351:x1874694611499904:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787848447.685504:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848447.685524:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b63f80f/0x9aeb41e0543cc431 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb56f expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787848447.685549:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a906700, blocks: 0x1 00010000:00010000:3.0:1787848447.685569:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1787848447.685574:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848447.685584:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b63f80f/0x9aeb41e0543cc431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb56f expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.685628:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b63f80f/0x9aeb41e0543cc431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb56f expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.685680:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236e00, rc 0) 00000100:00100000:3.0:1787848447.685757:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+11:2351:x1874694611499904:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 272us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848447.685765:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:1.0:1787848447.692037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.692183:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611500160 00000100:00100000:0.0:1787848447.692192:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611500160 00000100:00100000:0.0:1787848447.692254:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 226 00000100:00100000:0.0:1787848447.692265:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+66:11628:x1874694611500160:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787848447.692385:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+66:11628:x1874694611500160:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 122us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848447.692393:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 226 00000100:00100000:1.0:1787848447.695792:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.698707:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611500288 00000100:00100000:0.0:1787848447.698734:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611500288 00000100:00100000:2.0:1787848447.701304:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:2.0:1787848447.701318:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+11:11628:x1874694611500288:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848447.701338:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848447.701358:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb576 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.701410:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b63f80f/0x9aeb41e0543cc431 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb56f expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.701420:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848447.701425:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848447.701430:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.701475:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b63f80f/0x9aeb41e0543cc431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb56f expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.701490:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b63f80f/0x9aeb41e0543cc431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb56f expref: 12 pid: 6690 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848447.701505:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79415680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874694631412992:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848447.701616:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe410b2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787848447.708395:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79415680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874694631412992:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848447.708434:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.708456:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664c00, rc 0) 00000100:00100000:2.0:1787848447.708618:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:11628:x1874694611500288:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 7302us (12835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848447.708626:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:1.0:1787848447.710968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848447.711448:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611500416 00000100:00100000:2.0:1787848447.711458:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611500416 00010000:00010000:2.0:1787848447.711513:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b63f80f/0x9aeb41e0543cc431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb56f expref: 12 pid: 6690 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848447.711558:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:2.0:1787848447.711568:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:2351:x1874694611500416:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848447.711587:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848447.711610:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b63f80f/0x9aeb41e0543cc431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb56f expref: 12 pid: 6690 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.711625:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b63f80f/0x9aeb41e0543cc431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb56f expref: 12 pid: 6690 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.711674:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b63f80f/0x9aeb41e0543cc431 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb56f expref: 12 pid: 6690 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.711692:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848447.711696:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848447.711704:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.711724:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.711762:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848447.711793:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79415680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1874694631413120:192.168.201.26@tcp:105: 00000100:00100000:2.0:1787848447.717906:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe410b2840 going to sleep for 11 seconds 00000100:00100000:1.0:1787848447.718521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.718634:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611500544 00000100:00100000:0.0:1787848447.718664:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611500544 00002000:00100000:0.0:1787848447.718712:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93ff7fb48780 x1874694611500544/t0(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:153/0 lens 504/0 e 0 to 0 dl 1787848458 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787848447.718735:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff7fb48780 with x1874694611500544 ext(0->12) 00002000:00010000:0.0:1787848447.718740:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff7fb48780 00000100:00100000:0.0:1787848447.718767:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:0.0:1787848447.718777:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:2352:x1874694611500544:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787848447.719811:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79415680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1874694631413120:192.168.201.26@tcp:105: 00010000:00010000:2.0:1787848447.719835:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848447.720192:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+14:2352:x1874694611500544:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 Request processed in 1415us (1673us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787848447.720202:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00002000:00100000:0.0:1787848447.720212:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93ff7fb48780 x1874694611500544/t4294967320(0) o4->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:153/0 lens 504/448 e 0 to 0 dl 1787848458 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787848447.720221:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff7fb48780 with x1874694611500544 ext(0->12) 00002000:00010000:0.0:1787848447.720234:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff7fb48780 00000100:00100000:2.0:1787848447.720312:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:2351:x1874694611500416:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 8745us (9352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848447.720321:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:1.0:1787848447.723337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.723456:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611500672 00000100:00100000:0.0:1787848447.723474:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611500672 00000100:00100000:0.0:1787848447.723535:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 227 00000100:00100000:0.0:1787848447.723546:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+66:11628:x1874694611500672:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787848447.763170:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787848447.763191:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1787848447.763212:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ff431f3f00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787848447.763217:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff52c6a700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ff431f3b40 00000020:00080000:2.0:1787848447.763221:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff52c6ab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93fe42713400 00000004:00080000:2.0:1787848447.763242:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787848447.763263:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ff44f92a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787848447.763266:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff6ecec900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ff44f929c0 00000020:00080000:2.0:1787848447.763268:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff6ecec200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93fe42667800 00000004:00080000:2.0:1787848447.763298:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787848447.763448:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787848447.764222:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787848447.764300:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79415680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631413248:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787848447.764365:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848447.764406:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848447.764412:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79416d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631413376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787848447.764448:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848447.764575:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79417840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631413504:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787848447.764606:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848447.764656:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631413248 00000100:00100000:0.0:1787848447.764663:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631413248 00000100:00100000:0.0:1787848447.764726:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631413376 00000100:00100000:0.0:1787848447.764730:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631413376 00000100:00100000:0.0:1787848447.764742:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631413504 00000100:00100000:0.0:1787848447.764744:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631413504 00000100:00100000:0.0:1787848447.764758:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787848447.764766:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79414780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874694631413248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787848447.764790:0:6689:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1787848447.764816:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.764836:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4d5 expref: 12 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.764846:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1787848447.764851:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848447.764856:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.764884:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc201 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4d5 expref: 12 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.764906:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc201 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4d5 expref: 12 pid: 11455 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.764918:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fb8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874694631413632:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848447.764981:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431f33c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787848447.764993:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787848447.765021:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787848447.765762:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1874694631413376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787848447.765916:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787848447.765921:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787848448 00002000:00010000:0.0:1787848447.765923:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787848447.765926:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787848448 -> 1787848448 00002000:00010000:0.0:1787848447.765928:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787848447.765989:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1874694631413376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (1539us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787848447.769345:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787848447.769381:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787848447.769399:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631413504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787848447.769431:0:6691:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1787848447.769529:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9066fe, atime: 0x6a9066fe, ctime: 0x6a9066fe, blocks: 0x1 00010000:00010000:0.0:1787848447.769538:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e046d02/0x9aeb41e0543cc446 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.769555:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1787848447.769572:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848447.769579:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e046d02/0x9aeb41e0543cc446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.769594:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e046d02/0x9aeb41e0543cc446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.769604:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e046d02/0x9aeb41e0543cc446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.769613:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e046d02/0x9aeb41e0543cc446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.769654:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787848447.770171:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848447.770179:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e046d02/0x9aeb41e0543cc446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.770189:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848447.770193:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e046d02/0x9aeb41e0543cc446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.770202:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e046d02/0x9aeb41e0543cc446 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.770220:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e046d02/0x9aeb41e0543cc446 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.770229:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e046d02/0x9aeb41e0543cc446 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.770250:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848447.770252:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848447.770254:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848447.771425:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1874694631413504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2031us (6812us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787848447.771435:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1787848447.772794:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff79416d00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787848447.772809:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79416d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631413376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787848447.772919:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:11628:x1874694611500672:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 Request processed in 49373us (49590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848447.772929:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 227 00000004:00080000:2.0:1787848447.778388:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff79417840/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787848447.780183:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79417840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631413504:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787848447.781871:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848447.781904:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611500800 00000100:00100000:1.0:1787848447.781912:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611500800 00010000:00010000:1.0:1787848447.781956:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc201 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4d5 expref: 13 pid: 11455 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848447.781989:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 81 00000100:00100000:1.0:1787848447.781998:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:2351:x1874694611500800:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848447.782012:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848447.784071:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc201 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4d5 expref: 13 pid: 11455 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.784117:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc201 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4d5 expref: 13 pid: 11455 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.784146:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787848447.784150:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787848447.784155:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.784164:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.784191:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848447.784250:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+13:2351:x1874694611500800:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 2252us (2385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848447.784260:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 81 00010000:00010000:2.0:1787848447.789788:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc201 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4d5 expref: 12 pid: 11455 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848447.789814:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fb8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874694631413632:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848447.789855:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.789867:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.789874:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.789886:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.789895:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.789922:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787848447.790496:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79414780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3312:x1874694631413248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25729us (26129us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787848447.790506:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1787848447.790830:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848447.790838:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.790849:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848447.790861:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.790871:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.790890:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.790897:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c0d51b8/0x9aeb41e0543cc43f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.790919:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848447.790921:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848447.790923:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787848447.790954:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff79415680/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787848447.790960:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79415680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631413248:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787848447.796172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848447.797587:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611500928 00000100:00100000:1.0:1787848447.797602:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611500928 00000100:00100000:1.0:1787848447.797698:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:1.0:1787848447.797709:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:2353:x1874694611500928:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787848447.846560:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+12:2353:x1874694611500928:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 Request processed in 48836us (50380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848447.846577:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 68 00000001:00080000:1.0:1787848447.846624:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1787848447.846632:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1787848447.846686:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:0.0:1787848447.849911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848447.850762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611501184 00000100:00100000:3.0:1787848447.850772:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611501184 00000100:00100000:3.0:1787848447.850832:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 228 00000100:00100000:3.0:1787848447.850842:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:11628:x1874694611501184:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787848447.850899:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848447.850927:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc42a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb568 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.850948:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373400) 00010000:00010000:3.0:1787848447.850954:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848447.850984:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc44d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.850997:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc44d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.851021:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc44d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787848447.851377:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a21da4a reply state 000000008d3b9dba transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc44d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848447.851387:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787848447.852445:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:11628:x1874694611501184:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 1600us (2544us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787848447.852455:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 228 00010000:00010000:3.0:1787848447.857187:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc44d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.857205:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc44d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.857213:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc44d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.857218:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848447.857223:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc44d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.857231:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc44d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.857253:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373400) 00010000:00010000:3.0:1787848447.857257:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848447.857262:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc44d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.857267:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236200/0x9aeb41e0543cc44d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.857620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848447.857843:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611501312 00000100:00100000:2.0:1787848447.857854:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611501312 00000100:00100000:2.0:1787848447.857917:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:2.0:1787848447.857928:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611501312:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787848447.858242:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787848447.858246:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787848448 -> 1787848446 00002000:00010000:2.0:1787848447.858256:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787848446 00002000:00010000:2.0:1787848447.858259:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787848448 -> 1787848446 00002000:00010000:2.0:1787848447.858262:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787848447.858340:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611501312:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 414us (723us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787848447.858349:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:0.0:1787848447.864396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848447.864560:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611501568 00000100:00100000:3.0:1787848447.864571:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611501568 00000100:00100000:3.0:1787848447.864662:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 229 00000100:00100000:3.0:1787848447.864675:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff52190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:11628:x1874694611501568:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787848447.864758:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.864776:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc40e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb55a expref: 20 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.864787:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.864823:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc40e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb55a expref: 20 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.864836:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc40e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb55a expref: 20 pid: 9224 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848447.864851:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631413760:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848447.864940:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787848447.867589:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.867828:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611501696 00000100:00100000:0.0:1787848447.867839:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611501696 00010000:00010000:0.0:1787848447.867889:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc40e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb55a expref: 21 pid: 9224 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.867929:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:0.0:1787848447.867937:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:2351:x1874694611501696:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848447.867971:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848447.867978:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc40e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb55a expref: 21 pid: 9224 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.867992:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc40e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb55a expref: 21 pid: 9224 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.868121:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848447.868126:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.868138:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.868145:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.868164:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848447.868212:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:2351:x1874694611501696:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 275us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848447.868219:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 82 00010000:00010000:0.0:1787848447.869254:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148c600/0x9aeb41e0543cc40e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb55a expref: 20 pid: 9224 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.869274:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631413760:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848447.869297:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.869307:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.869324:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.869351:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.869359:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.869365:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.869371:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848447.869376:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.869383:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.869395:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373400) 00010000:00010000:0.0:1787848447.869397:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787848447.869413:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.869420:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc454 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.869491:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff52190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:11628:x1874694611501568:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 Request processed in 4819us (5104us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787848447.869500:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 229 00000100:00100000:3.0:1787848447.878815:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848447.878902:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611501824 00000100:00100000:2.0:1787848447.878912:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611501824 00000100:00100000:2.0:1787848447.878971:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:2.0:1787848447.878981:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2353:x1874694611501824:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787848447.879044:0:11455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.879065:0:11455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.879073:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848447.879077:0:11455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787848447.879082:0:11455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.879117:0:11455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.879132:0:11455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 8 pid: 6691 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848447.879169:0:11455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79414b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11455:1874694631413888:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848447.879251:0:11455:0:(client.c:2715:ptlrpc_set_wait()) set ffff93fe410b2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787848447.881761:0:11455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79414b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11455:1874694631413888:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848447.881788:0:11455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848447.883682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.883809:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611501952 00000100:00100000:0.0:1787848447.883820:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611501952 00010000:00010000:0.0:1787848447.883862:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 9 pid: 6691 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.883901:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 83 00000100:00100000:0.0:1787848447.883910:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+9:2352:x1874694611501952:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848447.883926:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848447.883951:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 9 pid: 6691 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.883965:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 9 pid: 6691 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.883989:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034f21958/0x9aeb41e0543cc438 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb576 expref: 9 pid: 6691 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.884013:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848447.884018:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848447.884027:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.884053:0:8522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.884083:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848447.884141:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2352:x1874694611501952:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 232us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848447.884149:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 83 00010000:00010000:2.0:1787848447.884405:0:11455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.884415:0:11455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.884443:0:11455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.884451:0:11455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.884468:0:11455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.884477:0:11455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848447.884482:0:11455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.884490:0:11455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.884515:0:11455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.884522:0:11455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000762a16d3/0x9aeb41e0543cc45b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848447.884570:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2353:x1874694611501824:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 Request processed in 5591us (5765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848447.884579:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:2.0:1787848447.887069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.887199:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611502208 00000100:00100000:0.0:1787848447.887209:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611502208 00000100:00100000:0.0:1787848447.887271:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 230 00000100:00100000:0.0:1787848447.887281:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79416580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:11628:x1874694611502208:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787848447.887375:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc462 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.887393:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.887415:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.887675:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.887687:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc41c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb561 expref: 20 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.887696:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.887768:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc41c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb561 expref: 20 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.887784:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc41c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb561 expref: 20 pid: 7097 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.887801:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631414016:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848447.887903:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431f3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787848447.892863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848447.892936:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611502336 00000100:00100000:2.0:1787848447.892945:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611502336 00010000:00010000:2.0:1787848447.892986:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc41c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb561 expref: 21 pid: 7097 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848447.893038:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 84 00000100:00100000:2.0:1787848447.893049:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:2351:x1874694611502336:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848447.893064:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848447.893071:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc41c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb561 expref: 21 pid: 7097 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.893084:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc41c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb561 expref: 21 pid: 7097 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.893112:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373400) 00010000:00010000:2.0:1787848447.893128:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.893138:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.893146:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.893167:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848447.893238:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:2351:x1874694611502336:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 191us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848447.893245:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 84 00010000:00010000:0.0:1787848447.893888:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc41c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb561 expref: 20 pid: 7097 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.893909:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631414016:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848447.893938:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.893948:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.893954:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787848447.894182:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787848447.894331:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787848447.894376:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787848447.894454:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff804d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874694631414144:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787848447.894520:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848447.894557:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431f39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848447.894781:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631414144 00000100:00100000:3.0:1787848447.894788:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631414144 00000100:00100000:3.0:1787848447.894829:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787848447.894844:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7935a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1874694631414144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787848447.894918:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7935a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1874694631414144:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848447.894924:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787848447.895107:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1787848447.895113:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1787848447.895129:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff79416d00, transno 4294967321 00000004:00080000:1.0:1787848447.895145:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff79415680, transno 4294967322 00000100:00100000:1.0:1787848447.895151:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff804d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874694631414144:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787848447.895624:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787848447.895730:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79194f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874694631414272:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787848447.895771:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848447.895790:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff4562c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787848447.896935:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631414272 00000100:00100000:3.0:1787848447.896945:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631414272 00000100:00100000:3.0:1787848447.896981:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787848447.896990:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79195680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1874694631414272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787848447.897216:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79195680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1874694631414272:12345-0@lo:1000:mdt00_001.0 Request processed in 226us (1444us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787848447.897223:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787848447.900968:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79194f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874694631414272:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787848447.901037:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901049:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901058:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901064:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848447.901068:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901076:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901093:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff48373400) 00010000:00010000:1.0:1787848447.901096:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787848447.901120:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901128:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc469 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901164:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901171:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901177:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901182:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848447.901184:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901190:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901199:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:1.0:1787848447.901201:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787848447.901209:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc3b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb545 expref: 23 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901220:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc3b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb545 expref: 23 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901229:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb545 expref: 23 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848447.901287:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb545 expref: 23 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848447.901304:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79196d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631414400:192.168.201.26@tcp:105: 00000100:00100000:1.0:1787848447.901424:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff4562c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787848447.906398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848447.906509:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611502464 00000100:00100000:2.0:1787848447.906518:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611502464 00000100:00100000:2.0:1787848447.906581:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:2.0:1787848447.906592:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79197840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:11627:x1874694611502464:12345-192.168.201.26@tcp:49:lfs.0 00000100:00100000:2.0:1787848447.906796:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79197840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+24:11627:x1874694611502464:12345-192.168.201.26@tcp:49:lfs.0 Request processed in 205us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848447.906805:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:0.0:1787848447.906991:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79196d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874694631414400:192.168.201.26@tcp:105: 00010000:00010000:0.0:1787848447.907048:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907059:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664000/0x9aeb41e0543cc3ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907099:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc470 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907114:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc470 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907127:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc470 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907136:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc470 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907143:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc470 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907150:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc470 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907155:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030e00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848447.907159:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc470 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907166:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc470 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907179:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:0.0:1787848447.907200:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848447.907206:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc470 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907212:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc470 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907224:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907231:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc462 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907236:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907241:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848447.907243:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907249:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc462 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907256:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:0.0:1787848447.907258:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787848447.907260:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc462 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.907266:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc462 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.907491:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79416580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:11628:x1874694611502208:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 20211us (20433us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787848447.907512:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 230 00000020:00080000:0.0:1787848447.907516:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787848447.907905:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787848447.907910:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787848447.908440:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787848447.908449:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787848447.912790:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848447.912830:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.912941:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611502720 00000100:00100000:0.0:1787848447.912952:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611502720 00000100:00100000:0.0:1787848447.913020:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 231 00000100:00100000:0.0:1787848447.913037:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:11627:x1874694611502720:12345-192.168.201.26@tcp:58:lfs.0 00000040:00080000:0.0:1787848447.913432:0:9224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787848447.913518:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:11627:x1874694611502720:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 481us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848447.913526:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 231 00000100:00100000:2.0:1787848447.914303:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611502976 00000100:00100000:2.0:1787848447.914312:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611502976 00000100:00100000:2.0:1787848447.914359:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:2.0:1787848447.914368:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff47b4ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+23:11628:x1874694611502976:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787848447.918666:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787848447.918875:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787848447.918954:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc477 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.918971:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.918982:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.918990:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc477 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.918997:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc477 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.919003:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc477 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848447.919037:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787848447.919162:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff47b4ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+25:11628:x1874694611502976:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 4790us (6326us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787848447.919174:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 62 00000020:00080000:2.0:1787848447.919180:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787848447.919856:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848447.919865:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc477 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.919871:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848447.919875:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc477 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.919883:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc477 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.919896:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ff53a89200) 00010000:00010000:0.0:1787848447.919899:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787848447.919903:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc477 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.919909:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665a00/0x9aeb41e0543cc477 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.919944:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848447.919946:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848447.919948:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848447.955340:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.955675:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611503104 00000100:00100000:0.0:1787848447.955685:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611503104 00000100:00100000:0.0:1787848447.955754:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 232 00000100:00100000:0.0:1787848447.955765:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f40ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+25:11630:x1874694611503104:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848447.955792:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848447.955816:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc47e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb57d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.955883:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc485 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.955898:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.955910:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.955924:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc48c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.955932:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc48c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.955939:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc48c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.956259:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.956278:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb53e expref: 26 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.956287:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.956322:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb53e expref: 26 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.956338:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb53e expref: 26 pid: 9224 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.956353:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79358f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631414528:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848447.956441:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff431f3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787848447.967678:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848447.967861:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611503360 00000100:00100000:1.0:1787848447.967871:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611503360 00000100:00100000:1.0:1787848447.967931:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:1.0:1787848447.967942:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:5594:x1874694611503360:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787848447.968192:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:5594:x1874694611503360:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 252us (560us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787848447.968202:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:0.0:1787848447.968959:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79358f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874694631414528:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848447.968987:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848447.975253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848447.975353:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611503488 00000100:00100000:0.0:1787848447.975364:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611503488 00010000:00010000:0.0:1787848447.975414:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb53e expref: 28 pid: 9224 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848447.975458:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 85 00000100:00100000:0.0:1787848447.975469:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79194780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:2352:x1874694611503488:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848447.975486:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848447.975508:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb53e expref: 28 pid: 9224 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.975521:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb53e expref: 28 pid: 9224 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.975547:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc39e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb53e expref: 28 pid: 9224 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.975565:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:0.0:1787848447.975571:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.975581:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.975590:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848447.975624:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787848447.978936:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.978955:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848447.979009:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787848447.979014:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848447.979035:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979053:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979063:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979088:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc485 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979096:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979103:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030e00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848447.979107:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979114:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc485 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979133:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:3.0:1787848447.979137:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848447.979144:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc485 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979150:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030e00/0x9aeb41e0543cc485 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979169:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc48c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979175:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc48c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979180:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc48c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979186:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848447.979195:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc48c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979201:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc48c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979209:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ff48373f00) 00010000:00010000:3.0:1787848447.979211:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848447.979214:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc48c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979220:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030a00/0x9aeb41e0543cc48c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979280:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc47e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb57d expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979295:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb57d expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848447.979303:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:3.0:1787848447.979305:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787848447.979308:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030000, rc 0) 00000100:00100000:3.0:1787848447.979392:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f40ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+27:11630:x1874694611503104:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 23628us (24060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848447.979402:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 232 00000100:00100000:3.0:1787848447.979465:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79194780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:2352:x1874694611503488:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 3999us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848447.979474:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 85 00010000:00010000:0.0:1787848448.047818:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787848448.942593:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1787848448.942616:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:0.0:1787848448.946723:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787848448.946734:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787848448.946785:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787848448.946791:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787848448.946934:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79358f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631414656:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787848448.947062:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff463a6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787848448.951911:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79358f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874694631414656:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787848448.959429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848448.960031:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611503616 00000100:00100000:0.0:1787848448.960048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611503616 00000100:00100000:0.0:1787848448.960125:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 233 00000100:00100000:0.0:1787848448.960136:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11641:x1874694611503616:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787848448.960175:0:5843:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787848448.960295:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11641:x1874694611503616:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 160us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848448.960303:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 233 00000100:00080000:2.0:1787848448.961070:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848448.965809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848448.965899:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611503872 00000100:00100000:2.0:1787848448.965910:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611503872 00000100:00100000:2.0:1787848448.965973:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 234 00000100:00100000:2.0:1787848448.965983:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+26:11641:x1874694611503872:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848448.966006:0:7097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848448.966027:0:7097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc49a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb584 expref: -99 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.966145:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc4a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.966172:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.966186:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848448.966201:0:7097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787848448.966341:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc49a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb584 expref: 29 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.966358:0:7097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb584 expref: 28 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.966366:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:2.0:1787848448.966369:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787848448.966373:0:7097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665200, rc 0) 00000100:00100000:2.0:1787848448.966444:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:11641:x1874694611503872:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 462us (714us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787848448.966451:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 234 00000100:00100000:1.0:1787848448.978435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848448.978718:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611504128 00000100:00100000:2.0:1787848448.978729:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611504128 00000100:00100000:2.0:1787848448.978802:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 235 00000100:00100000:2.0:1787848448.978813:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79195e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+28:11641:x1874694611504128:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787848448.979319:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4af lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.979346:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.979359:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.979554:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.979562:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.979569:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.979575:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848448.979580:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.979587:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.979600:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:2.0:1787848448.979603:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787848448.979608:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4af lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.979614:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4af lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848448.980081:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79195e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11641:x1874694611504128:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 1265us (1651us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787848448.980102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 235 00000040:00080000:2.0:1787848448.980415:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787848448.980422:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787848448.981450:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787848448.981462:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787848448.984336:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848448.984425:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848448.984462:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611504512 00000100:00100000:1.0:1787848448.984471:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611504512 00000100:00100000:1.0:1787848448.984523:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:1.0:1787848448.984533:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79195a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11641:x1874694611504512:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787848448.985341:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79195a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:11641:x1874694611504512:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 806us (911us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787848448.985361:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:2.0:1787848448.985760:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611504256 00000100:00100000:2.0:1787848448.985767:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611504256 00000100:00100000:2.0:1787848448.985809:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:2.0:1787848448.985818:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f9fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+30:2351:x1874694611504256:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848448.985829:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848448.985855:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc4a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb584 expref: 30 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848448.985872:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:2.0:1787848448.985877:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848448.986110:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f9fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:2351:x1874694611504256:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 292us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848448.986118:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000040:00080000:1.0:1787848449.002132:0:12535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787848449.002142:0:12535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787848449.002267:0:12535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787848449.002274:0:12535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787848449.072794:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848449.214771:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848449.214829:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611504768 00000100:00100000:0.0:1787848449.214842:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611504768 00000100:00100000:0.0:1787848449.214917:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 236 00000100:00100000:0.0:1787848449.214928:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+29:11654:x1874694611504768:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848449.214955:0:9224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848449.214977:0:9224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc4b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb58b expref: -99 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848449.215205:0:9224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc4bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848449.215222:0:9224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc4bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848449.215236:0:9224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc4bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848449.215246:0:9224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787848449.215375:0:9224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030200/0x9aeb41e0543cc4b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb58b expref: 32 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848449.215428:0:9224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc4bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb58b expref: 31 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848449.215438:0:9224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:0.0:1787848449.215442:0:9224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787848449.215445:0:9224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40031600, rc 0) 00000100:00100000:0.0:1787848449.215509:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+31:11654:x1874694611504768:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 583us (746us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787848449.215517:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 236 00000100:00100000:0.0:1787848449.222287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848449.222356:0:7097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611504896 00000100:00100000:2.0:1787848449.222366:0:7097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611504896 00000100:00100000:2.0:1787848449.222425:0:7097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 237 00000100:00100000:2.0:1787848449.222436:0:7097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79358f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+31:11654:x1874694611504896:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:2.0:1787848449.222509:0:7097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848449.222527:0:7097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848449.222555:0:7097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848449.222581:0:7097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848449.222588:0:7097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848449.222596:0:7097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848449.222602:0:7097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848449.222606:0:7097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848449.222614:0:7097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848449.222625:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:2.0:1787848449.222628:0:7097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787848449.222633:0:7097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848449.222717:0:7097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc4cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848449.222891:0:7097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79358f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+31:11654:x1874694611504896:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 456us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848449.222899:0:7097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 237 00000100:00100000:1.0:1787848449.343113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848449.343344:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611505024 00000100:00100000:2.0:1787848449.343575:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611505024 00000100:00100000:2.0:1787848449.343702:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00100000:2.0:1787848449.343715:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79196940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2354:x1874694611505024:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:2.0:1787848449.343741:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848449.343763:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc4d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb592 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787848449.343790:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9066fe, atime: 0x6a9066fe, ctime: 0x6a9066fe, blocks: 0xb 00010000:00010000:2.0:1787848449.343812:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=398s v=(0 0) 00010000:00010000:2.0:1787848449.343817:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848449.343826:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb592 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848449.343845:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb592 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848449.343859:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664a00, rc 0) 00000100:00100000:2.0:1787848449.343914:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79196940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2354:x1874694611505024:12345-192.168.201.26@tcp:101:cat.0 Request processed in 201us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848449.343922:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00080000:0.0:1787848449.344594:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787848449.349201:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848449.349297:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611505152 00000100:00100000:1.0:1787848449.349307:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611505152 00002000:00100000:1.0:1787848449.349357:0:6695:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff93ff79359680 x1874694611505152/t0(0) o3->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:155/0 lens 488/0 e 0 to 0 dl 1787848460 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787848449.349381:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff79359680 with x1874694611505152 ext(0->4095) 00002000:00010000:1.0:1787848449.349386:0:6695:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff79359680 00000100:00100000:1.0:1787848449.349421:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:1.0:1787848449.349431:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79359680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2353:x1874694611505152:12345-192.168.201.26@tcp:3:cat.0 00000100:00100000:1.0:1787848449.349718:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79359680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2353:x1874694611505152:12345-192.168.201.26@tcp:3:cat.0 Request processed in 287us (525us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787848449.349726:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00002000:00100000:1.0:1787848449.349733:0:6695:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff93ff79359680 x1874694611505152/t0(0) o3->8bb0bb0f-4511-40a8-bdfa-25f441891529@192.168.201.26@tcp:155/0 lens 488/4536 e 0 to 0 dl 1787848460 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787848449.349740:0:6695:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff93ff79359680 with x1874694611505152 ext(0->4095) 00002000:00010000:1.0:1787848449.349744:0:6695:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ff79359680 00000100:00100000:2.0:1787848449.393612:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787848449.393653:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79416d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631414912:0@lo:400:kworker.0 00000100:00100000:2.0:1787848449.393746:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848449.393835:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631414912 00000100:00100000:2.0:1787848449.393843:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631414912 00000100:00100000:2.0:1787848449.393895:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787848449.393904:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79415680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631414912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848449.393977:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79415680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631414912:12345-0@lo:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848449.393985:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787848449.394097:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787848449.394109:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79415e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631414784:0@lo:400:kworker.0 00000100:00100000:3.0:1787848449.394148:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848449.394223:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5edc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631415168:0@lo:400:kworker.0 00000100:00100000:3.0:1787848449.394251:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848449.394289:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787848449.394295:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5edc3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631415296:0@lo:400:kworker.0 00000100:00100000:3.0:1787848449.394330:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848449.394380:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5edc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631415040:0@lo:400:kworker.0 00000100:00100000:3.0:1787848449.394404:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848449.394446:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79416d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631414912:0@lo:400:kworker.0 00000100:00100000:3.0:1787848449.394472:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848449.394478:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5edc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631415424:0@lo:400:kworker.0 00000100:00100000:3.0:1787848449.394504:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848449.394538:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631415168 00000100:00100000:3.0:1787848449.394542:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631415168 00000100:00100000:3.0:1787848449.394579:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631415424 00000100:00100000:3.0:1787848449.394585:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631415424 00000100:00100000:3.0:1787848449.394608:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787848449.394615:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631415168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848449.394674:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631415168:12345-0@lo:400:kworker.0 Request processed in 60us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848449.394680:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787848449.394709:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787848449.394726:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631415424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848449.394760:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631415424:12345-0@lo:400:kworker.0 Request processed in 35us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848449.394765:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787848449.394788:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787848449.394793:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787848449.394808:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff79417840, transno 4294967310 00000100:00100000:3.0:1787848449.394820:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5edc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631415168:0@lo:400:kworker.0 00000100:00100000:3.0:1787848449.394843:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5edc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631415424:0@lo:400:kworker.0 00000100:00080000:0.0:1787848449.395361:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787848449.395366:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787848449.395378:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631415296 00000100:00100000:0.0:1787848449.395382:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631415296 00000100:00100000:0.0:1787848449.395427:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631415040 00000100:00100000:0.0:1787848449.395430:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631415040 00000100:00100000:0.0:1787848449.395451:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787848449.395458:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631415296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848449.395509:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631415296:12345-0@lo:400:kworker.0 Request processed in 50us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848449.395516:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787848449.395531:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787848449.395536:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631415040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848449.395570:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631415040:12345-0@lo:400:kworker.0 Request processed in 34us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848449.395584:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787848449.395619:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5edc3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631415296:0@lo:400:kworker.0 00000100:00100000:0.0:1787848449.395660:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5edc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631415040:0@lo:400:kworker.0 00000100:00080000:3.0:1787848449.395783:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848449.395849:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631414784 00000100:00100000:1.0:1787848449.395854:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631414784 00000100:00100000:1.0:1787848449.395892:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787848449.395906:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631414784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848449.395955:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631414784:12345-0@lo:400:kworker.0 Request processed in 50us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848449.395962:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787848449.396116:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79415e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631414784:0@lo:400:kworker.0 00000100:00100000:3.0:1787848449.907593:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5edc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631415552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848449.907720:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848449.908368:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631415552 00000100:00100000:2.0:1787848449.908377:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631415552 00000100:00100000:2.0:1787848449.908430:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787848449.908440:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631415552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848449.908477:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848449.908539:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631415552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848449.908549:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787848449.908825:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5edc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631415552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848449.910882:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79194b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631415680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848449.910954:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848449.911184:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631415680 00000100:00100000:1.0:1787848449.911191:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631415680 00000100:00100000:1.0:1787848449.911240:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787848449.911250:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631415680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848449.911281:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848449.911335:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631415680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848449.911342:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787848449.911419:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79194b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631415680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787848450.097911:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848451.121241:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848451.780387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848451.780445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848451.780489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848451.780501:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611505280 00000100:00100000:2.0:1787848451.780515:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611505280 00000100:00100000:0.0:1787848451.780563:0:11455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611505536 00000100:00100000:0.0:1787848451.780568:0:11455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611505536 00000100:00100000:2.0:1787848451.780584:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 313 00000100:00100000:2.0:1787848451.780596:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2351:x1874694611505280:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848451.780624:0:11455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:0.0:1787848451.780633:0:11455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2351:x1874694611505536:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848451.780734:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611505792 00000100:00100000:1.0:1787848451.780739:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611505792 00000100:00100000:1.0:1787848451.780778:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 191 00000100:00100000:1.0:1787848451.780786:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611505792:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848451.780853:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2351:x1874694611505280:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 259us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848451.780861:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 313 00000100:00080000:2.0:1787848451.780922:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787848451.780928:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787848451.787480:0:11455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2351:x1874694611505536:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 6836us (7020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848451.787497:0:11455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:1.0:1787848451.788859:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2351:x1874694611505792:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 8065us (8361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848451.788873:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 191 00000100:00100000:3.0:1787848451.791543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848451.791623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848451.791690:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611505408 00000100:00100000:0.0:1787848451.791702:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611505408 00000100:00100000:0.0:1787848451.791804:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 192 00000100:00100000:0.0:1787848451.791816:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+31:2351:x1874694611505408:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848451.791900:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+31:2351:x1874694611505408:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 88us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848451.791908:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 192 00000100:00080000:3.0:1787848451.792045:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848451.792565:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611505664 00000100:00100000:1.0:1787848451.792571:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611505664 00000100:00100000:1.0:1787848451.792629:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:1.0:1787848451.792678:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2351:x1874694611505664:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848451.792727:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+8:2351:x1874694611505664:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 91us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848451.792734:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00080000:3.0:1787848451.792928:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787848452.145830:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787848453.045748:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1787848453.045773:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1787848453.077188:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787848453.077227:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ff4562c780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787848453.077241:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff6ecece00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ff4562c900 00000020:00080000:0.0:1787848453.077245:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ff6ecec400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ff807a6800 00000020:00080000:0.0:1787848453.077269:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787848453.077426:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787848453.077667:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1787848453.169505:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848454.192194:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848454.512903:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79359e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631416192:0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.512968:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848454.513023:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787848454.513028:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79358780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631415808:0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.513054:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848454.513073:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79359a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631416320:0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.513091:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848454.513112:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7935a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631415936:0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.513130:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848454.513144:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7935b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631416448:0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.513159:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848454.513172:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787848454.513176:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff793592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631416064:0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.513192:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848454.513218:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631416192 00000100:00100000:0.0:1787848454.513223:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631416192 00000100:00100000:0.0:1787848454.513267:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631416448 00000100:00100000:0.0:1787848454.513270:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631416448 00000100:00100000:0.0:1787848454.513291:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787848454.513299:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7935a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631416192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.513343:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7935a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631416192:12345-0@lo:400:kworker.0 Request processed in 45us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848454.513360:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787848454.513375:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787848454.513380:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7935bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631416448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.513406:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7935bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631416448:12345-0@lo:400:kworker.0 Request processed in 26us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848454.513411:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787848454.513426:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631415808 00000100:00100000:0.0:1787848454.513429:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631415808 00000100:00100000:0.0:1787848454.513450:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787848454.513455:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631415808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.513477:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631415808:12345-0@lo:400:kworker.0 Request processed in 22us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848454.513483:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787848454.513504:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631416320 00000100:00100000:0.0:1787848454.513507:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631416320 00000100:00100000:0.0:1787848454.513528:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631415936 00000100:00100000:0.0:1787848454.513530:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631415936 00000100:00100000:0.0:1787848454.513541:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631416064 00000100:00100000:0.0:1787848454.513543:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631416064 00000100:00100000:0.0:1787848454.513554:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787848454.513559:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79358b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631416320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.513582:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79358b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631416320:12345-0@lo:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848454.513588:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787848454.513608:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787848454.513614:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff793583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631415936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.513663:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff793583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631415936:12345-0@lo:400:kworker.0 Request processed in 49us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848454.513670:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787848454.513682:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787848454.513688:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7935b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631416064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.513710:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7935b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631416064:12345-0@lo:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848454.513715:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1787848454.514502:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787848454.514509:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787848454.514511:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787848454.514556:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff793592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631416064:0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.514567:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7935a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631415936:0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.514576:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787848454.514581:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1787848454.514613:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7935b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631416448:0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.514664:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79358780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631415808:0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.514676:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79359a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631416320:0@lo:400:kworker.0 00000100:00100000:0.0:1787848454.514686:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79359e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631416192:0@lo:400:kworker.0 00000100:00100000:0.0:1787848455.025098:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5edc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631416576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848455.025165:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848455.025261:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631416576 00000100:00100000:3.0:1787848455.025270:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631416576 00000100:00100000:1.0:1787848455.025291:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79197c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631416704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848455.025330:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787848455.025331:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848455.025347:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79359e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631416576:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848455.025364:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631416704 00000100:00100000:1.0:1787848455.025367:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631416704 00002000:00000024:3.0:1787848455.025383:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848455.025385:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787848455.025390:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631416704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848455.025407:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848455.025440:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631416704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848455.025449:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787848455.025493:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79197c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631416704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848455.025623:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79359e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631416576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 278us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848455.025631:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787848455.026375:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5edc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631416576:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787848455.153971:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787848455.153982:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787848455.154269:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787848455.154275:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787848455.216789:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848455.548375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848455.548480:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611505920 00000100:00100000:0.0:1787848455.548504:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611505920 00000100:00100000:0.0:1787848455.548617:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 238 00000100:00100000:0.0:1787848455.548629:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79414b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:11314:x1874694611505920:12345-192.168.201.26@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1787848455.548875:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848455.549163:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79414b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:11314:x1874694611505920:12345-192.168.201.26@tcp:60:lhsmtool_posix.0 Request processed in 536us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848455.549179:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 238 00000100:00100000:2.0:1787848455.553096:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848455.553321:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611506176 00000100:00100000:0.0:1787848455.553332:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611506176 00000100:00100000:0.0:1787848455.553391:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:0.0:1787848455.553401:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79415e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:11314:x1874694611506176:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787848455.554882:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79415e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:11314:x1874694611506176:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 1478us (1790us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787848455.554900:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:3.0:1787848455.945609:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848455.945758:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611506304 00000100:00100000:1.0:1787848455.945769:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611506304 00000100:00100000:1.0:1787848455.945834:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 239 00000100:00100000:1.0:1787848455.945843:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:12106:x1874694611506304:12345-192.168.201.26@tcp:101:lsof.0 00010000:00010000:1.0:1787848455.945864:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848455.945882:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc4d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb599 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787848455.946468:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787848455.946585:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc4e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848455.946601:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848455.946613:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848455.946868:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787848455.946874:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848455.946985:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848455.947015:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc4d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb599 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848455.947031:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc4e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb599 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848455.947049:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:1.0:1787848455.947052:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787848455.947055:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42ec00, rc 0) 00000100:00100000:1.0:1787848455.947201:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:12106:x1874694611506304:12345-192.168.201.26@tcp:101:lsof.0 Request processed in 1358us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848455.947210:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 239 00010000:00010000:0.0:1787848456.244719:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848456.904048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848456.904107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848456.904141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848456.904177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848456.904211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848456.904222:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611506944 00000100:00100000:3.0:1787848456.904234:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611506944 00000100:00100000:2.0:1787848456.904238:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611506560 00000100:00100000:2.0:1787848456.904244:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611506560 00000100:00100000:1.0:1787848456.906233:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611506432 00000100:00100000:1.0:1787848456.906246:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611506432 00000100:00100000:0.0:1787848456.906328:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611506688 00000100:00100000:0.0:1787848456.906333:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611506688 00000100:00100000:1.0:1787848456.914635:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 315 00000100:00100000:1.0:1787848456.914677:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611506432:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848456.914771:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2352:x1874694611506432:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 108us (10735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848456.914779:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 315 00000100:00100000:2.0:1787848456.915608:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 196 00000100:00100000:2.0:1787848456.915621:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79416d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2352:x1874694611506944:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848456.915687:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79416d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2352:x1874694611506944:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 71us (11545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848456.915694:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 196 00000100:00100000:2.0:1787848456.915783:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 197 00000100:00100000:2.0:1787848456.915791:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fb49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:2352:x1874694611506560:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848456.915838:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fb49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:2352:x1874694611506560:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 48us (11661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848456.915844:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 197 00000100:00080000:2.0:1787848456.915889:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787848456.917865:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611506816 00000100:00100000:1.0:1787848456.917879:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611506816 00000100:00100000:1.0:1787848456.917983:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00100000:1.0:1787848456.917999:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79417840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611506688:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848456.918073:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79417840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2352:x1874694611506688:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 79us (13965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848456.918081:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00100000:2.0:1787848456.921898:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 118 00000100:00100000:2.0:1787848456.921919:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611506816:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848456.922226:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2352:x1874694611506816:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 312us (18013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848456.922263:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 118 00000100:00080000:3.0:1787848456.922802:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787848457.263894:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787848458.178588:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787848458.178613:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787848458.178670:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787848458.178683:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787848458.287843:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848459.311819:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848459.632377:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631417088:0@lo:400:kworker.0 00000100:00100000:2.0:1787848459.632450:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848459.632543:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787848459.632550:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631416960:0@lo:400:kworker.0 00000100:00100000:2.0:1787848459.632573:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848459.632591:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631417472:0@lo:400:kworker.0 00000100:00100000:2.0:1787848459.632619:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848459.632672:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631417088 00000100:00100000:2.0:1787848459.632681:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631417088 00000100:00100000:2.0:1787848459.632725:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631416960 00000100:00100000:2.0:1787848459.632729:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631416960 00000100:00100000:2.0:1787848459.632747:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787848459.632755:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631417088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848459.632801:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631417088:12345-0@lo:400:kworker.0 Request processed in 48us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848459.632807:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787848459.632821:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787848459.632826:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5ee1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631416960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848459.632849:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5ee1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874694631416960:12345-0@lo:400:kworker.0 Request processed in 23us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848459.633072:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f022580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631417216:0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633103:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848459.633127:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787848459.633132:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631416832:0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633158:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848459.633181:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631417344:0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633207:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848459.633231:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631416832 00000100:00100000:0.0:1787848459.633234:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631416832 00000100:00100000:0.0:1787848459.633277:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787848459.633285:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631416832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633323:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3310:x1874694631416832:12345-0@lo:400:kworker.0 Request processed in 40us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848459.633336:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787848459.633380:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631416832:0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633422:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631417472 00000100:00100000:0.0:1787848459.633426:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631417472 00000100:00100000:0.0:1787848459.633455:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631417216 00000100:00100000:0.0:1787848459.633457:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631417216 00000100:00100000:0.0:1787848459.633481:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787848459.633488:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80786940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631417472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633533:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80786940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631417472:12345-0@lo:400:kworker.0 Request processed in 46us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848459.633539:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787848459.633551:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787848459.633557:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79359a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631417216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633586:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79359a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631417216:12345-0@lo:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848459.633592:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787848459.633608:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631417344 00000100:00100000:0.0:1787848459.633611:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631417344 00000100:00100000:0.0:1787848459.633629:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787848459.633635:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79358780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631417344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633686:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79358780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631417344:12345-0@lo:400:kworker.0 Request processed in 51us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848459.633693:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787848459.633723:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631417344:0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633734:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f022580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631417216:0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633811:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874694631416960:0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633822:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631417472:0@lo:400:kworker.0 00000100:00100000:0.0:1787848459.633832:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631417088:0@lo:400:kworker.0 00000100:00100000:2.0:1787848459.634094:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1787848459.637022:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848459.637033:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848459.637036:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848460.143937:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787848460.143966:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79197c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631417600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848460.144043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848460.144046:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7935a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631417728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848460.144075:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848460.144108:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631417600 00000100:00100000:0.0:1787848460.144108:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631417728 00000100:00100000:1.0:1787848460.144116:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631417600 00000100:00100000:0.0:1787848460.144116:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631417728 00000100:00100000:0.0:1787848460.144169:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787848460.144178:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff793592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631417728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787848460.144213:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848460.144264:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff793592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631417728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848460.144271:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787848460.144298:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7935a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631417728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848460.144604:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787848460.144613:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631417600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848460.144632:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848460.146114:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631417600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1493us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848460.146128:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787848460.149305:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79197c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631417600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787848460.338934:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787848460.600407:0:12738:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:34:19 (1787848459) 00010000:00010000:3.0:1787848461.371569:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848462.031057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848462.031108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848462.031140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848462.031163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848462.031193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848462.032528:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611507200 00000100:00100000:3.0:1787848462.032557:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611507200 00000100:00100000:3.0:1787848462.032659:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611507584 00000100:00100000:3.0:1787848462.032664:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611507584 00000100:00100000:3.0:1787848462.032702:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 201 00000100:00100000:3.0:1787848462.032713:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:2353:x1874694611507200:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848462.032826:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:2353:x1874694611507200:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 115us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848462.032835:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 201 00000100:00100000:3.0:1787848462.032857:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 202 00000100:00100000:3.0:1787848462.032865:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2353:x1874694611507584:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848462.032895:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2353:x1874694611507584:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 32us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848462.032901:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 202 00000100:00100000:3.0:1787848462.032926:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611507456 00000100:00100000:3.0:1787848462.032931:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611507456 00000100:00100000:3.0:1787848462.032962:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611507328 00000100:00100000:3.0:1787848462.032966:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611507328 00000100:00100000:3.0:1787848462.032991:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:3.0:1787848462.032998:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2353:x1874694611507456:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848462.033027:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2353:x1874694611507456:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 30us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848462.033033:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:3.0:1787848462.033044:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00100000:3.0:1787848462.033051:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611507328:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848462.033076:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2353:x1874694611507328:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 26us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848462.033091:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00100000:3.0:1787848462.033113:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611507072 00000100:00100000:3.0:1787848462.033117:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611507072 00000100:00100000:3.0:1787848462.033146:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 317 00000100:00100000:3.0:1787848462.033153:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2353:x1874694611507072:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848462.033183:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2353:x1874694611507072:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 30us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848462.033189:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 317 00000100:00080000:3.0:1787848462.037525:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848462.037541:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848462.037546:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787848462.386283:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848463.410971:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848464.432380:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848464.751894:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631417856:0@lo:400:kworker.0 00000100:00100000:0.0:1787848464.751982:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848464.752142:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631417856 00000100:00100000:1.0:1787848464.752153:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631417856 00000100:00100000:1.0:1787848464.752218:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1787848464.752229:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff430b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631417856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848464.752269:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631417984:0@lo:400:kworker.0 00000100:00100000:2.0:1787848464.752351:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848464.752390:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848464.752397:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631418112:0@lo:400:kworker.0 00000100:00100000:2.0:1787848464.752463:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848464.752495:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631417984 00000100:00100000:2.0:1787848464.752499:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631417984 00000100:00100000:2.0:1787848464.752532:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631418112 00000100:00100000:2.0:1787848464.752534:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631418112 00000100:00100000:2.0:1787848464.752568:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787848464.752574:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff80787c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631417984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848464.752614:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff80787c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631417984:12345-0@lo:400:kworker.0 Request processed in 40us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848464.752623:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787848464.752675:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787848464.752682:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5edc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631418112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848464.752714:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5edc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631418112:12345-0@lo:400:kworker.0 Request processed in 34us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848464.752720:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1787848464.752739:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848464.752751:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631418240:0@lo:400:kworker.0 00000100:00100000:2.0:1787848464.752779:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848464.752810:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631418240 00000100:00100000:2.0:1787848464.752814:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631418240 00000100:00100000:2.0:1787848464.752848:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787848464.752867:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631418240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848464.752901:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631418240:12345-0@lo:400:kworker.0 Request processed in 36us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848464.752907:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1787848464.752926:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848464.752954:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631418240:0@lo:400:kworker.0 00000100:00100000:2.0:1787848464.752979:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631418112:0@lo:400:kworker.0 00000100:00100000:2.0:1787848464.752988:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631417984:0@lo:400:kworker.0 00000100:00100000:3.0:1787848464.756562:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848464.756588:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631418496:0@lo:400:kworker.0 00000100:00100000:3.0:1787848464.756810:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848464.756863:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631418496 00000100:00100000:3.0:1787848464.756870:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631418496 00000100:00100000:3.0:1787848464.756924:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787848464.756933:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631418496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848464.756979:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631418496:12345-0@lo:400:kworker.0 Request processed in 48us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848464.756987:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1787848464.757010:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787848464.757036:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631418496:0@lo:400:kworker.0 00000100:00100000:2.0:1787848464.757272:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787848464.757284:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631418368:0@lo:400:kworker.0 00000100:00100000:2.0:1787848464.757321:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848464.757414:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631418368 00000100:00100000:3.0:1787848464.757429:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631418368 00000100:00100000:3.0:1787848464.757487:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787848464.757493:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631418368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848464.757530:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631418368:12345-0@lo:400:kworker.0 Request processed in 37us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848464.757535:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:2.0:1787848464.757590:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848464.757757:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631418368:0@lo:400:kworker.0 00000100:00100000:1.0:1787848464.764565:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff430b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631417856:12345-0@lo:400:kworker.0 Request processed in 12327us (12571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848464.764583:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787848464.764889:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631417856:0@lo:400:kworker.0 00000100:00100000:3.0:1787848465.264071:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631418624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848465.264168:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848465.264372:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631418624 00000100:00100000:2.0:1787848465.264380:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631418624 00000100:00100000:2.0:1787848465.264468:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787848465.264478:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631418624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848465.264518:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848465.266873:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787848465.266897:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7935b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631418752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848465.269885:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631418624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5397us (5715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848465.269905:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787848465.271114:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848465.271603:0:11150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631418752 00000100:00100000:0.0:1787848465.271613:0:11150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631418752 00000100:00100000:0.0:1787848465.271695:0:11150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787848465.271705:0:11150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79197c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631418752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787848465.271756:0:11150:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848465.271843:0:11150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79197c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631418752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848465.271850:0:11150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787848465.274252:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7935b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631418752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848465.278704:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631418624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848465.330445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848465.330564:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611507840 00000100:00100000:0.0:1787848465.330575:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611507840 00000100:00100000:0.0:1787848465.330680:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 66 00000100:00100000:0.0:1787848465.330692:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79194f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+18:12328:x1874694611507840:12345-192.168.201.26@tcp:35:umount.0 00000100:00100000:0.0:1787848465.331899:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79194f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:12328:x1874694611507840:12345-192.168.201.26@tcp:35:umount.0 Request processed in 1202us (1461us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787848465.331910:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 66 00000100:00080000:2.0:1787848465.332011:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848465.336803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848465.338804:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611508096 00000100:00100000:0.0:1787848465.338821:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611508096 00000100:00100000:0.0:1787848465.338895:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 67 00000100:00100000:0.0:1787848465.338907:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+19:12328:x1874694611508096:12345-192.168.201.26@tcp:35:umount.0 00000100:00100000:0.0:1787848465.340323:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:12328:x1874694611508096:12345-192.168.201.26@tcp:35:umount.0 Request processed in 1410us (3524us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787848465.340335:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 67 00000100:00100000:3.0:1787848465.347396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848465.352082:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611508352 00000100:00100000:1.0:1787848465.352100:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611508352 00000100:00100000:1.0:1787848465.352188:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:1.0:1787848465.352199:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff47b4f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+20:12328:x1874694611508352:12345-192.168.201.26@tcp:35:umount.0 00000100:00100000:1.0:1787848465.352769:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff47b4f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:12328:x1874694611508352:12345-192.168.201.26@tcp:35:umount.0 Request processed in 559us (5372us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787848465.352778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:0.0:1787848465.361374:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848465.363727:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611508608 00000100:00100000:1.0:1787848465.363746:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611508608 00000100:00100000:1.0:1787848465.363833:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:1.0:1787848465.363844:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+21:12328:x1874694611508608:12345-192.168.201.26@tcp:35:umount.0 00000100:00100000:1.0:1787848465.366958:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:12328:x1874694611508608:12345-192.168.201.26@tcp:35:umount.0 Request processed in 3101us (5580us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787848465.366975:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:3.0:1787848465.373560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848465.373679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848465.383350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848465.391244:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611508864 00000100:00100000:0.0:1787848465.392466:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611508864 00000100:00100000:3.0:1787848465.398745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848465.400504:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611508736 00000100:00100000:2.0:1787848465.400519:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611508736 00000100:00100000:2.0:1787848465.400559:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611509376 00000100:00100000:2.0:1787848465.400563:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611509376 00000100:00100000:2.0:1787848465.400689:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00100000:2.0:1787848465.400702:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2350:x1874694611509376:12345-192.168.201.26@tcp:9:umount.0 00000020:00000080:2.0:1787848465.400761:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cba98 00000020:00010000:2.0:1787848465.400771:0:6691:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93ff5f537000: total 0 00000100:00080000:2.0:1787848465.400776:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93ff5f532800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787848465.401778:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787848465.404195:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2350:x1874694611509376:12345-192.168.201.26@tcp:9:umount.0 Request processed in 3292us (5262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848465.404212:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00080000:2.0:1787848465.404492:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787848465.405193:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611508992 00000100:00100000:2.0:1787848465.405204:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611508992 00000100:00100000:2.0:1787848465.405241:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:2.0:1787848465.405661:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+15:2354:x1874694611508864:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848465.405684:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848465.405708:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff414a4400/0x9aeb41e0543cb4be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb0ec expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848465.406211:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848465.406404:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+14:2354:x1874694611508864:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 1152us (32851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848465.406431:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:2.0:1787848465.406461:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:2.0:1787848465.406471:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+13:2354:x1874694611508736:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848465.406482:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848465.406494:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c7200/0x9aeb41e0543cb558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb124 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848465.406524:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848465.406680:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:2354:x1874694611508736:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 210us (32999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848465.406688:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:2.0:1787848465.406704:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:2.0:1787848465.406711:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:2354:x1874694611508992:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787848465.406733:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848465.406745:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff79237600/0x9aeb41e0543cb76c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1ef expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848465.408224:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848465.409237:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2354:x1874694611508992:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 2517us (25889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848465.409597:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000020:00010000:2.0:1787848465.410230:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93ff5f537000: total 0 00010000:00010000:2.0:1787848465.410696:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93ff5f537000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787848465.411248:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc8b823c/0x9aeb41e0543cbe34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3c4 expref: 4 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848465.412228:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005157d7e/0x9aeb41e0543cc4d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb592 expref: 3 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848465.412248:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93ff5f537000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787848465.412907:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848465.412910:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848465.413305:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787848465.413682:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787848465.413689:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787848465.418498:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787848465.418520:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787848465.433355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848465.434321:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611509504 00000100:00100000:0.0:1787848465.434333:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611509504 00000100:00100000:0.0:1787848465.434431:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 73 00000100:00100000:0.0:1787848465.434442:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+5:2350:x1874694611509504:12345-192.168.201.26@tcp:9:umount.0 00000100:00080000:2.0:1787848465.434540:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1787848465.434853:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb830 00000100:00080000:0.0:1787848465.434867:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93ff60305800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787848465.434923:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787848465.435708:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+2:2350:x1874694611509504:12345-192.168.201.26@tcp:9:umount.0 Request processed in 1012us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848465.435722:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 73 00010000:00010000:2.0:1787848465.435810:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848465.459743:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848465.460565:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611510528 00000100:00100000:3.0:1787848465.460576:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611510528 00000100:00100000:3.0:1787848465.460668:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 240 00000100:00100000:3.0:1787848465.460680:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7935b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+22:2350:x1874694611510528:12345-192.168.201.26@tcp:39:umount.0 00000020:00000080:3.0:1787848465.460721:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb4cc 00000020:00010000:3.0:1787848465.460744:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93ff79391000: total 0 00000100:00080000:3.0:1787848465.460750:0:5842:0:(import.c:65:import_set_state_nolock()) ffff93ff79392800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1787848465.462436:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93ff79391000: total 0 00010000:00010000:2.0:1787848465.462446:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848465.462734:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93ff79391000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787848465.462781:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff48373e00) 00010000:00010000:0.0:1787848465.462786:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848465.462801:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031a00/0x9aeb41e0543cb7b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb204 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.462836:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:0.0:1787848465.462839:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848465.462843:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff4148da00/0x9aeb41e0543cbe96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3e0 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.462859:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:0.0:1787848465.462861:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848465.462865:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665e00/0x9aeb41e0543cbdf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3af expref: 19 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.462879:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:0.0:1787848465.462882:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848465.462886:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40030000/0x9aeb41e0543cc493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb57d expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.462898:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:0.0:1787848465.462901:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787848465.462905:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff40031600/0x9aeb41e0543cc4bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb58b expref: 17 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.462937:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848465.462939:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787848465.462945:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79236400/0x9aeb41e0543cbaf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb2eb expref: 16 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.462959:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ff53a89b00) 00010000:00010000:0.0:1787848465.462961:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848465.462965:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cb796 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1fd expref: 15 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.462978:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:0.0:1787848465.462981:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787848465.462984:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e200/0x9aeb41e0543cbe1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3bd expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.463010:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:0.0:1787848465.463012:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787848465.463016:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237400/0x9aeb41e0543cc191 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb4b9 expref: 13 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.463028:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ff541a1b00) 00010000:00010000:0.0:1787848465.463038:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787848465.463042:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237e00/0x9aeb41e0543cb806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb219 expref: 12 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.463057:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ff541a1700) 00010000:00010000:0.0:1787848465.463060:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787848465.463071:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665800/0x9aeb41e0543cc3b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb545 expref: 11 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.463090:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ff43951000) 00010000:00010000:0.0:1787848465.463092:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787848465.463095:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e600/0x9aeb41e0543cbeb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb3e7 expref: 10 pid: 7097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.463109:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ff48373700) 00010000:00010000:0.0:1787848465.463111:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787848465.463115:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f800/0x9aeb41e0543cbd15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb377 expref: 9 pid: 9224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848465.463127:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93ff79391000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787848465.463138:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848465.463140:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848465.463142:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787848465.463375:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00010000:00010000:2.0:1787848465.463858:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848465.469909:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7935b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bb0bb0f-4511-40a8-bdfa-25f441891529+7:2350:x1874694611510528:12345-192.168.201.26@tcp:39:umount.0 Request processed in 9202us (10148us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787848465.469950:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 240 00010000:00010000:0.0:1787848466.479803:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848467.146532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848467.146607:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848467.146712:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611510656 00000100:00100000:2.0:1787848467.146730:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611510784 00000100:00100000:3.0:1787848467.146731:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611510656 00000100:00100000:2.0:1787848467.146747:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611510784 00000100:00100000:3.0:1787848467.146838:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 319 00000100:00100000:2.0:1787848467.146845:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 206 00000100:00100000:3.0:1787848467.146855:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2353:x1874694611510656:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848467.146869:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79195a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2353:x1874694611510784:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848467.146972:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2353:x1874694611510656:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 121us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848467.146982:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 319 00000100:00080000:0.0:1787848467.146986:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848467.147513:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79195a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2353:x1874694611510784:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 655us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848467.147523:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 206 00010000:00010000:2.0:1787848467.504446:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848468.153529:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848468.153581:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848468.153635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848468.153700:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611510912 00000100:00100000:2.0:1787848468.153714:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611510912 00000100:00100000:1.0:1787848468.153744:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611511168 00000100:00100000:1.0:1787848468.153749:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611511168 00000100:00100000:2.0:1787848468.153845:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611511040 00000100:00100000:2.0:1787848468.153850:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611511040 00000100:00100000:1.0:1787848468.154179:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:1.0:1787848468.154625:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7935a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+12:2351:x1874694611510912:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848468.154677:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848468.154707:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c6200/0x9aeb41e0543cb59e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb139 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848468.154744:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848468.154826:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7935a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+11:2351:x1874694611510912:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 209us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848468.154835:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:1.0:1787848468.155720:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:1.0:1787848468.155740:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7935b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+10:2351:x1874694611511168:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848468.155754:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848468.155773:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cb765 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb1e8 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848468.155788:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848468.155823:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7935b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+9:2351:x1874694611511168:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 93us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848468.155830:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:1.0:1787848468.155857:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:1.0:1787848468.155865:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7935ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+8:2351:x1874694611511040:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848468.155878:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848468.155889:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c7a00/0x9aeb41e0543cb5a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb163 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848468.155898:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848468.155918:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7935ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b6bbff9-6edf-442f-a60a-abc2c14840e9+7:2351:x1874694611511040:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 54us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848468.155925:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:1.0:1787848468.169060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848468.169231:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611511424 00000100:00100000:2.0:1787848468.169246:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611511424 00000100:00100000:2.0:1787848468.169341:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 241 00000100:00100000:2.0:1787848468.169354:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79194f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+6:2350:x1874694611511424:12345-192.168.201.26@tcp:39:umount.0 00000020:00000080:2.0:1787848468.169444:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb5b3 00000020:00010000:2.0:1787848468.169457:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93ff431a7000: total 0 00000100:00080000:2.0:1787848468.169462:0:5843:0:(import.c:65:import_set_state_nolock()) ffff93ff431a0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787848468.169503:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787848468.169850:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79194f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13b431d3-ab16-497c-a7b0-79b9099e7ad1+5:2350:x1874694611511424:12345-192.168.201.26@tcp:39:umount.0 Request processed in 499us (803us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787848468.169869:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 241 00000020:00010000:3.0:1787848468.169987:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93ff431a7000: total 0 00010000:00010000:3.0:1787848468.170043:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93ff431a7000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787848468.170098:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff48373300) 00010000:00010000:3.0:1787848468.170103:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787848468.170114:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ec00/0x9aeb41e0543cc4e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb599 expref: 4 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848468.170144:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93ff431a7000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787848468.170156:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848468.170158:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848468.170160:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848468.204090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848468.204289:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611511680 00000100:00100000:0.0:1787848468.204308:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611511680 00000100:00100000:0.0:1787848468.204411:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 320 00000100:00100000:0.0:1787848468.204424:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+7:2350:x1874694611511680:12345-192.168.201.26@tcp:251:umount.0 00000020:00000080:0.0:1787848468.204489:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb4a9 00000020:00010000:0.0:1787848468.204498:0:5836:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93ff79397000: total 0 00000100:00080000:0.0:1787848468.204504:0:5836:0:(import.c:65:import_set_state_nolock()) ffff93ff79397800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787848468.204634:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b6bbff9-6edf-442f-a60a-abc2c14840e9+3:2350:x1874694611511680:12345-192.168.201.26@tcp:251:umount.0 Request processed in 213us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848468.204679:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 320 00000020:00010000:2.0:1787848468.204808:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93ff79397000: total 0 00010000:00010000:2.0:1787848468.204814:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848468.204887:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93ff79397000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787848468.204931:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff50665600/0x9aeb41e0543cb55f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb12b expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848468.204947:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93ff79397000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787848468.204958:0:5830:0:(genops.c:885:class_export_put()) final put ffff93ff79397000/0b6bbff9-6edf-442f-a60a-abc2c14840e9 00010000:00010000:2.0:1787848468.204982:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848468.204984:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848468.204986:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787848468.205035:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff79397000/0b6bbff9-6edf-442f-a60a-abc2c14840e9 for MGS 00000020:00000080:3.0:1787848468.205101:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff79397800 for MGS 00000001:00100000:1.0:1787848468.427895:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00000020:00000080:1.0:1787848468.427909:0:7658:0:(genops.c:885:class_export_put()) final put ffff93ff5f537000/8bb0bb0f-4511-40a8-bdfa-25f441891529 00000020:00000080:1.0:1787848468.427947:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f537000/8bb0bb0f-4511-40a8-bdfa-25f441891529 for lustre-OST0001 00000020:00000080:1.0:1787848468.428005:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff5f532800 for lustre-OST0001 00000001:00080000:1.0:1787848468.437200:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00080000:1.0:1787848468.437229:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1787848468.437243:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 13b431d3-ab16-497c-a7b0-79b9099e7ad1 00000001:00080000:1.0:1787848468.437252:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787848468.437256:0:5864:0:(genops.c:885:class_export_put()) final put ffff93ff431a7000/13b431d3-ab16-497c-a7b0-79b9099e7ad1 00000001:00100000:1.0:1787848468.437284:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00000001:00080000:1.0:1787848468.437292:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787848468.437294:0:5864:0:(genops.c:885:class_export_put()) final put ffff93ff79391000/8bb0bb0f-4511-40a8-bdfa-25f441891529 00000020:00000080:1.0:1787848468.437310:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff431a7000/13b431d3-ab16-497c-a7b0-79b9099e7ad1 for lustre-MDT0000 00000020:00000080:1.0:1787848468.437390:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff79391000/8bb0bb0f-4511-40a8-bdfa-25f441891529 for lustre-MDT0000 00000020:00000080:1.0:1787848468.437436:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff431a0800 for lustre-MDT0000 00000020:00000080:1.0:1787848468.437441:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff79392800 for lustre-MDT0000 00010000:00010000:1.0:1787848468.527988:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787848469.489261:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8bb0bb0f-4511-40a8-bdfa-25f441891529 00000020:00000080:0.0:1787848469.489272:0:6716:0:(genops.c:885:class_export_put()) final put ffff93ff7fa79000/8bb0bb0f-4511-40a8-bdfa-25f441891529 00000020:00000080:0.0:1787848469.489307:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff7fa79000/8bb0bb0f-4511-40a8-bdfa-25f441891529 for lustre-OST0000 00000020:00000080:0.0:1787848469.489382:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff60305800 for lustre-OST0000 00010000:00010000:2.0:1787848469.552147:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848469.874014:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631419008:0@lo:400:kworker.0 00000100:00100000:0.0:1787848469.874117:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848469.874223:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631419136:0@lo:400:kworker.0 00000100:00100000:0.0:1787848469.874253:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848469.874306:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631419008 00000100:00100000:0.0:1787848469.874317:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631419008 00000100:00100000:0.0:1787848469.874393:0:9224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631419136 00000100:00100000:0.0:1787848469.874397:0:9224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631419136 00000100:00100000:0.0:1787848469.874436:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787848469.874447:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f022580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631419008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848469.874515:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f022580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631419008:12345-0@lo:400:kworker.0 Request processed in 70us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848469.874524:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787848469.874543:0:9224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787848469.874549:0:9224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631419136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848469.874583:0:9224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631419136:12345-0@lo:400:kworker.0 Request processed in 34us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848469.874590:0:9224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1787848469.874609:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848469.874681:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631419008:0@lo:400:kworker.0 00000100:00100000:0.0:1787848469.874714:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631419136:0@lo:400:kworker.0 00000100:00100000:0.0:1787848469.875018:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631419520:0@lo:400:kworker.0 00000100:00100000:0.0:1787848469.875076:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848469.875226:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631418880:0@lo:400:kworker.0 00000100:00100000:2.0:1787848469.875269:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848469.875307:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631419392:0@lo:400:kworker.0 00000100:00100000:2.0:1787848469.875346:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848469.875374:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787848469.875380:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631419264:0@lo:400:kworker.0 00000100:00100000:2.0:1787848469.875404:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848469.875435:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631419392 00000100:00100000:2.0:1787848469.875440:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631419392 00000100:00100000:2.0:1787848469.875484:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787848469.875492:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631419392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848469.875537:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874694631419392:12345-0@lo:400:kworker.0 Request processed in 45us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848469.875544:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787848469.875586:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631419520 00000100:00100000:2.0:1787848469.875590:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631419520 00000100:00100000:2.0:1787848469.875633:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631419264 00000100:00100000:2.0:1787848469.875636:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631419264 00000100:00100000:2.0:1787848469.875680:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787848469.875688:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79192580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631419520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848469.875870:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79192580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631419520:12345-0@lo:400:kworker.0 Request processed in 182us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848469.875878:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787848469.875891:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787848469.875898:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631419264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848469.875929:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631419264:12345-0@lo:400:kworker.0 Request processed in 32us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848469.875936:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1787848469.875963:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787848469.875968:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787848469.875971:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848469.876008:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631419520:0@lo:400:kworker.0 00000100:00100000:2.0:1787848469.876038:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff78eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631419264:0@lo:400:kworker.0 00000100:00100000:2.0:1787848469.876048:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631419392:0@lo:400:kworker.0 00000100:00100000:0.0:1787848469.876830:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631418880 00000100:00100000:0.0:1787848469.876839:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631418880 00000100:00100000:0.0:1787848469.876887:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787848469.876896:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6ec2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631418880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848469.876956:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6ec2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631418880:12345-0@lo:400:kworker.0 Request processed in 62us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848469.876963:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787848469.877185:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631418880:0@lo:400:kworker.0 00000100:00100000:3.0:1787848470.384062:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848470.384089:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631419648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848470.384173:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848470.384330:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631419648 00000100:00100000:2.0:1787848470.384342:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631419648 00000100:00100000:2.0:1787848470.384412:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787848470.384421:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631419648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848470.384468:0:6693:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848470.384533:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631419648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848470.384539:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787848470.384636:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631419648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787848470.388082:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787848470.388113:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79191e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631419776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848470.388217:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848470.388475:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631419776 00000100:00100000:0.0:1787848470.388487:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631419776 00000100:00100000:0.0:1787848470.388559:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787848470.388570:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631419776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787848470.388624:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848470.388753:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79191e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631419776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848470.388998:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631419776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848470.389007:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000020:01000004:2.0:1787848470.513852:0:12940:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787848470.527837:0:12940:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787848470.527905:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.527924:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.527932:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.527950:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.527980:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787848470.527988:0:12940:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787848470.528016:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787848470.528022:0:12940:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787848470.528029:0:12940:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787848470.528060:0:12940:0:(import.c:65:import_set_state_nolock()) ffff93ff4ed0c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787848470.528113:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848470.528121:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.528129:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5400 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:0.0:1787848470.528132:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.528141:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848470.528149:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848470.528155:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787848470.528157:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787848470.528160:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787848470.528193:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.528211:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787848470.528231:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.528238:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a5400/0x9aeb41e0543cb52e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb535 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.528252:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848470.528254:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848470.528255:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848470.531315:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631420032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848470.531846:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79191a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874694631419904:0@lo:39:umount.0 00000100:00100000:0.0:1787848470.531920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848470.532087:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848470.532181:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631419904 00000100:00100000:2.0:1787848470.532192:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631419904 00000100:00100000:2.0:1787848470.532249:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787848470.532260:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874694631419904:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787848470.532297:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb2b8 00000100:00080000:2.0:1787848470.532308:0:5842:0:(import.c:65:import_set_state_nolock()) ffff93ff8138a800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787848470.532400:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1874694631419904:12345-0@lo:39:umount.0 Request processed in 130us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848470.532407:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787848470.532419:0:5842:0:(genops.c:885:class_export_put()) final put ffff93ff81389800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787848470.532453:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787848470.532495:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff4ed0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787848470.532509:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79191a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874694631419904:0@lo:39:umount.0 00000020:00000080:1.0:1787848470.533812:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff81389800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787848470.533892:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff8138a800 for lustre-MDT0000 00000100:00080000:2.0:1787848470.541706:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787848470.541720:0:12940:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787848470.541729:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1787848470.543523:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631420032 00000100:00100000:0.0:1787848470.543545:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631420032 00010000:00010000:2.0:1787848470.543933:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848470.543951:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787848470.543964:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff6f9ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3311:x1874694631420032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787848470.543973:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.543981:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.543986:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848470.543988:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.544011:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c7000/0x9aeb41e0543cb535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb52e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544016:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787848470.544022:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544029:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.544030:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848470.544034:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544040:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544052:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787848470.544056:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787848470.544063:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544064:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848470.544070:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5000 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:0.0:1787848470.544074:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544084:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544091:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.544095:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848470.544104:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544105:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544111:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848470.544111:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787848470.544114:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787848470.544118:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787848470.544124:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a0c00/0x9aeb41e0543cb217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544128:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a0c00/0x9aeb41e0543cb217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544134:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff413a0c00/0x9aeb41e0543cb217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544140:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff413a0c00/0x9aeb41e0543cb217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.544143:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.544147:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787848470.544149:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1787848470.544151:0:12940:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787848470.544156:0:12940:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1787848470.544174:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.544181:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a5000/0x9aeb41e0543cb53c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.544193:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787848470.544196:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787848470.544199:0:12940:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:0.0:1787848470.544201:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236a00 already unused, calling callback (ffffffffc1b83c20) 00000020:01000000:2.0:1787848470.544203:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 10000000:00010000:0.0:1787848470.544204:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787848470.544208:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1787848470.544210:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787848470.544214:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 10000000:00010000:0.0:1787848470.544216:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787848470.544219:0:12940:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93ff4ed08800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787848470.544225:0:12940:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93ff80489800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:0.0:1787848470.544227:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787848470.544229:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787848470.544231:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:2.0:1787848470.544237:0:12940:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff93ff5f6b4d70) has exports, disconnecting them 00000020:00080000:2.0:1787848470.544243:0:12940:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93ff4ed08800), last request at 1787848469 00010000:00010000:0.0:1787848470.544243:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.544248:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:2.0:1787848470.544250:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb42b 00010000:00010000:0.0:1787848470.544254:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.544259:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cb757 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb75e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787848470.544268:0:12940:0:(import.c:65:import_set_state_nolock()) ffff93ff4ed09000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787848470.544268:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848470.544271:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff413a0c00/0x9aeb41e0543cb217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.544276:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff413a0c00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:0.0:1787848470.544279:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0c00/0x9aeb41e0543cb217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848470.544285:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff413a0c00/0x9aeb41e0543cb217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848470.544290:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a0c00/0x9aeb41e0543cb217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848470.544296:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787848470.544298:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787848470.544299:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:2.0:1787848470.544315:0:12940:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ff4ed08800): rc 0 00010000:00010000:0.0:1787848470.544330:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff413a0c00/0x9aeb41e0543cb217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787848470.544331:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff4ed08800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1787848470.544335:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1787848470.544351:0:12940:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93ff80489800), last request at 1787848469 00010000:00010000:0.0:1787848470.544352:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff413a0c00/0x9aeb41e0543cb217 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787848470.544354:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb360 00000100:00080000:2.0:1787848470.544359:0:12940:0:(import.c:65:import_set_state_nolock()) ffff93ff8048f800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787848470.544360:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff413a0c00/0x9aeb41e0543cb217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb21e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787848470.544375:0:12940:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ff80489800): rc 0 00010000:00010000:0.0:1787848470.544376:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787848470.544378:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff80489800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1787848470.544378:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848470.544380:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1787848470.544388:0:12940:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa9c040d17ae0 00000100:00080000:2.0:1787848470.544417:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787848470.544422:0:12940:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1787848470.544436:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787848470.544562:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631420288:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1787848470.544581:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff4ed08800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787848470.544630:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff80489800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787848470.544668:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff4ed09000 for lustre-MDT0000 00000020:00000080:1.0:1787848470.544676:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff8048f800 for lustre-MDT0000 00000100:00100000:0.0:1787848470.544696:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787848470.546051:0:12940:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787848470.546087:0:12940:0:(import.c:65:import_set_state_nolock()) ffff93ff515f6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787848470.546117:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787848470.546121:0:12940:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1787848470.546139:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787848470.546219:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631420544:0@lo:9:umount.0 00000100:00100000:2.0:1787848470.546290:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848470.547130:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631420544 00000100:00100000:2.0:1787848470.547142:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631420544 00000100:00100000:2.0:1787848470.547214:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787848470.547227:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff78eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874694631420544:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787848470.547266:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb3ad 00000100:00080000:2.0:1787848470.547277:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93fe41349800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787848470.547357:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787848470.547535:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848470.547548:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79190b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631420160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848470.547597:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848470.547978:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff78eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3309:x1874694631420544:12345-0@lo:9:umount.0 Request processed in 752us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848470.547988:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787848470.548043:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff515f6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787848470.548056:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787848470.548059:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787848470.548063:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631420544:0@lo:9:umount.0 00000100:00080000:2.0:1787848470.548099:0:12940:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787848470.548121:0:12940:0:(import.c:65:import_set_state_nolock()) ffff93fe41341800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787848470.548147:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631420672:0@lo:9:umount.0 00000100:00100000:2.0:1787848470.548179:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848470.548217:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631420672 00000100:00100000:2.0:1787848470.548222:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631420672 00000100:00100000:2.0:1787848470.548254:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787848470.548263:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874694631420672:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787848470.548286:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb494 00000100:00080000:2.0:1787848470.548296:0:6690:0:(import.c:65:import_set_state_nolock()) ffff93fe41349000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787848470.548358:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787848470.548602:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3309:x1874694631420672:12345-0@lo:9:umount.0 Request processed in 339us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848470.548609:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787848470.548670:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93fe41341800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787848470.548677:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787848470.548679:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787848470.548681:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631420672:0@lo:9:umount.0 00000020:00080000:2.0:1787848470.548726:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93ff5f6b4d70) has no exports 00000100:00100000:3.0:1787848470.549226:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631420288 00000100:00100000:3.0:1787848470.549233:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631420288 00000100:00100000:3.0:1787848470.549298:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787848470.549306:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79193480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+19:3313:x1874694631420288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848470.549329:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848470.549356:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40030600/0x9aeb41e0543cb75e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb757 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848470.549373:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848470.549730:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79193c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631420416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787848470.550017:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79193480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:3313:x1874694631420288:12345-0@lo:103:ldlm_bl.0 Request processed in 711us (5320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848470.550027:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787848470.550591:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631420160 00000100:00100000:1.0:1787848470.550601:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631420160 00000100:00100000:2.0:1787848470.550688:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787848470.550700:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+18:3313:x1874694631420160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787848470.550714:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848470.550731:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c6a00/0x9aeb41e0543cb543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb53c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848470.550746:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848470.550787:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:3313:x1874694631420160:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (3190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848470.550794:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787848470.550913:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848470.551130:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631420416 00000100:00100000:1.0:1787848470.551135:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631420416 00000100:00100000:1.0:1787848470.551175:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787848470.551184:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+17:3310:x1874694631420416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787848470.551194:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848470.551204:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff414a4e00/0x9aeb41e0543cb21e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb217 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848470.551221:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848470.551264:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+16:3310:x1874694631420416:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848470.551272:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787848470.551313:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79193c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3310:1874694631420416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848470.551488:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79190b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631420160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848470.551500:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631420288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787848470.551546:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848470.551720:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff6f9ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:3311:x1874694631420032:12345-0@lo:103:ldlm_bl.0 Request processed in 7758us (19632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848470.551729:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787848470.551852:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631420032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787848470.552069:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848470.552073:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848470.552074:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848470.552108:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848470.552120:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff413a1000 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848470.552125:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848470.552136:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848470.552144:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848470.552150:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787848470.552153:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787848470.552167:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787848470.552203:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848470.552210:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848470.552246:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848470.552256:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff413a1000/0x9aeb41e0543cb463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb46a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848470.552273:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848470.552275:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848470.552276:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848470.552329:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631420800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848470.552386:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848470.552522:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631420800 00000100:00100000:1.0:1787848470.552528:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631420800 00000100:00100000:1.0:1787848470.552571:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787848470.552579:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+15:3311:x1874694631420800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787848470.552591:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848470.552603:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff413a1c00/0x9aeb41e0543cb46a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb463 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848470.552617:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848470.552674:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7+14:3311:x1874694631420800:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848470.552681:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787848470.552857:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3311:1874694631420800:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787848470.565120:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93ff5f6b4d70) has no exports 00010000:00010000:0.0:1787848470.576804:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787848470.631563:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb272 00000020:00000080:3.0:1787848470.631583:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff80245800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787848470.631618:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787848470.631909:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff80245800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787848470.634272:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787848470.634297:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787848470.634305:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff93ff51034d70) has no exports 00000020:00000080:2.0:1787848470.641437:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb26b 00000020:00000080:2.0:1787848470.641458:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff81394800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787848470.641547:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff81394800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787848470.641564:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787848470.641583:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787848470.641587:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff81397000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787848470.641590:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff81397000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787848470.641618:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1787848470.641883:0:12940:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ff6edae480 - data ffff93ff7fe7e510/ffff93ff792d9400 00000020:01000000:2.0:1787848470.642070:0:12940:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ff510ffc60 - data ffff93ff72fc5948/ffff93ff7a494c00 00000001:00000004:0.0:1787848470.665018:0:12940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1787848470.836934:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787848470.836947:0:12940:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787848470.836988:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787848470.836992:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787848470.837954:0:6882:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787848470.837962:0:6882:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787848470.837976:0:6882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787848470.847612:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787848470.847635:0:12940:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787848470.847789:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787848470.847793:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787848470.854361:0:7936:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787848470.854383:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787848470.854404:0:7936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787848470.952077:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb23a 00000020:00000080:0.0:1787848470.952099:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff5f6b8800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787848470.958594:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb24f 00000020:00000080:0.0:1787848470.958755:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff5f6bb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787848470.958832:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f6b8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787848470.959006:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787848470.959015:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787848470.959028:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787848470.959035:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff93ff5f6b0000) has no exports 00000004:01000000:0.0:1787848470.959253:0:12940:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787848470.959267:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb48d 00000020:00000080:0.0:1787848470.959272:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff5f353800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787848470.959483:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f6bb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787848470.959569:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787848470.959574:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787848470.959583:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787848470.959587:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff93ff7fcc8000) has no exports 00000020:00000080:0.0:1787848470.959597:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb486 00000020:00000080:0.0:1787848470.959613:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff52dd2800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787848470.959827:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f353800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1787848470.960493:0:12940:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787848470.960500:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787848470.960507:0:12940:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787848470.960517:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787848470.960520:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787848470.960556:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff52dd2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787848470.960846:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787848470.960876:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787848470.960887:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb3a6 00000020:00000080:0.0:1787848470.960900:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff8048d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787848470.960968:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93fe41341800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787848470.960978:0:8:0:(genops.c:885:class_export_put()) final put ffff93ff4ed0e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787848470.960980:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff4ed0e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787848470.960987:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787848470.961154:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787848470.961170:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787848470.961176:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787848470.961180:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff93ff520acd70) has no exports 00000020:00000080:0.0:1787848470.961188:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb39f 00000020:00000080:0.0:1787848470.961195:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff515f5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787848470.961355:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff8048d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787848470.961788:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff515f5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787848470.962007:0:12940:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787848470.962012:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787848470.962016:0:12940:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787848470.962020:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787848470.962024:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787848470.962100:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787848470.962109:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787848470.962154:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787848470.962164:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787848470.962168:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff505cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787848470.962171:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff505cd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787848470.962216:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787848470.962439:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb256 00000020:00000080:0.0:1787848470.962445:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff5f6bc800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787848470.962540:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff515f6800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787848470.962548:0:8:0:(genops.c:885:class_export_put()) final put ffff93ff80488800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787848470.962551:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff80488800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787848470.962555:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787848470.962960:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787848470.962966:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787848470.962973:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787848470.962978:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff93ff5f6b33a0) has no exports 00000020:00000080:0.0:1787848470.963009:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787848470.963013:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787848470.963019:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb25d 00000020:00000080:0.0:1787848470.963025:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff5f6b8000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787848470.963048:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f6bc800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787848470.963053:0:8:0:(genops.c:885:class_export_put()) final put ffff93ff5f6bf800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787848470.963055:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f6bf800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787848470.963060:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1787848470.963350:0:12940:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ff506b3000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787848470.963355:0:12940:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ff506b3000 3 00000020:01000004:0.0:1787848470.963359:0:12940:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93ff506b3000 from lustre-MDT0000 00000020:00000080:0.0:1787848470.963488:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787848470.963493:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787848470.963508:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff5f6bc000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787848470.963511:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f6bc000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787848470.963520:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787848470.963553:0:12940:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787848470.963557:0:12940:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787848470.963561:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787848470.963564:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787848470.963567:0:12940:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787848470.963575:0:12940:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff93ff520f8800 ee9ab6f4-b2e0-4733-95b2-22f99571fbe7 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787848470.963582:0:12940:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff93ff6ee699d0) has exports, disconnecting them 00000020:00080000:0.0:1787848470.963587:0:12940:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93ff520f8800), last request at 1787848199 00000020:00000080:0.0:1787848470.963614:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb1fb 00000020:00010000:0.0:1787848470.963626:0:12940:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93ff520f8800: total 1 00000100:00080000:0.0:1787848470.963632:0:12940:0:(import.c:65:import_set_state_nolock()) ffff93ff520fc000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787848470.963828:0:12940:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ff520f8800): rc 0 00000020:00080000:0.0:1787848470.963833:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff93ff6ee699d0) has no exports 00000020:00010000:3.0:1787848470.963947:0:12941:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93ff520f8800: total 1 00010000:00010000:3.0:1787848470.963987:0:12941:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93ff520f8800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787848470.964024:0:12941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff50664600/0x9aeb41e0543cb750 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb749 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848470.964057:0:12941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40031c00/0x9aeb41e0543cb742 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb73b expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848470.964076:0:12941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff50665400/0x9aeb41e0543cb551 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb54a expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848470.964088:0:12941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40030800/0x9aeb41e0543cb313 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb30c expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848470.964101:0:12941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c7800/0x9aeb41e0543cb4fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb4f6 expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848470.964113:0:12941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff414a4800/0x9aeb41e0543cb50b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb504 expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848470.964126:0:12941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff444c7600/0x9aeb41e0543cb519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb512 expref: 3 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848470.964137:0:12941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cb527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aeb41e0543cb520 expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848470.964148:0:12941:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93ff520f8800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787848470.964161:0:12941:0:(genops.c:885:class_export_put()) final put ffff93ff520f8800/ee9ab6f4-b2e0-4733-95b2-22f99571fbe7 00000020:00000080:1.0:1787848470.964216:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f6b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787848470.964291:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848470.964294:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848470.964296:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848470.964404:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff93ff6faf8000:5837] 2 exiting: rc = 0 00000100:00100000:3.0:1787848470.964539:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff93ff521f3e00:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1787848470.964823:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff93ff6faf8400:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1787848470.964926:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.964946:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.964955:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.964965:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.964972:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.964979:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.964985:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.964991:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.964998:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965005:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965013:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965019:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965025:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965032:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965039:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965045:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965052:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965059:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965065:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965072:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965078:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965084:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965090:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965096:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965102:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965108:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965115:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965122:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965129:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965136:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965142:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965148:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965153:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965159:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965167:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965174:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965187:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965193:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965198:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965204:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965209:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965216:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965222:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965227:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965232:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965237:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965243:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965248:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965254:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965259:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965265:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965270:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965276:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965281:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965286:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965292:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965297:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965303:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965324:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965331:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965336:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965342:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965348:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848470.965354:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787848470.966041:0:12940:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787848470.966047:0:12940:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1787848470.969250:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff520f8800/ee9ab6f4-b2e0-4733-95b2-22f99571fbe7 for MGS 00000020:00000080:1.0:1787848470.969492:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff520fc000 for MGS 00000020:01000000:3.0:1787848470.969559:0:12940:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ff6edae540 - data ffff93ff7fe7e000/ffff93ff792da000 00000020:01000000:3.0:1787848470.969992:0:12940:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ff42d8da20 - data ffff93ff6443bbd0/ffff93ff52181c00 00000020:00000080:3.0:1787848470.971862:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb1df 00000020:00000080:3.0:1787848470.971875:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff430a0000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787848470.971947:0:12940:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ff506b3000 from MGS, refs=2 00000020:01000004:3.0:1787848470.972010:0:12940:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ff506b3000 2 00000020:01000004:3.0:1787848470.972015:0:12940:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93ff506b3000 from MGS 00000020:00000080:3.0:1787848470.972048:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787848470.972057:0:12940:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787848470.972060:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff430a3000/MGS 00000020:00000080:3.0:1787848470.972064:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff430a3000/MGS for MGS 00000020:01000000:3.0:1787848470.972072:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787848470.972145:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787848470.972149:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787848470.972156:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787848470.972165:0:12940:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93ff67c38000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787848470.972172:0:12940:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff93ff5f6b19d0) has exports, disconnecting them 00000020:00080000:3.0:1787848470.972178:0:12940:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93ff67c38000), last request at 1787848200 00000020:00000080:3.0:1787848470.972183:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb2aa 00000020:00080000:3.0:1787848470.972198:0:12940:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ff67c38000): rc 0 00000020:00000080:3.0:1787848470.972204:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff67c38000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787848470.972261:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff430a0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787848470.974346:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff67c38000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787848470.975948:0:12940:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787848470.975959:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787848470.975965:0:12940:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787848470.975974:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787848470.976219:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787848470.976230:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787848470.976239:0:12940:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ff506b3000 1 00000020:00000080:0.0:1787848470.976247:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb1d1 00000020:00000080:0.0:1787848470.976257:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff430a6800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787848470.976265:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787848470.976272:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787848470.976276:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787848470.976280:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff93ff51030000) has no exports 00000020:00000080:1.0:1787848470.979612:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff4ed0c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787848470.979668:0:8:0:(genops.c:885:class_export_put()) final put ffff93ff4ed0f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787848470.979673:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff4ed0f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787848470.979685:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787848470.979813:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff430a6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787848471.041918:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787848471.041945:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787848471.041955:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff506b3800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787848471.041962:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff506b3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787848471.041971:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787848471.042147:0:12940:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93ff506b5000 00000020:01000000:1.0:1787848471.042192:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787848471.042437:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787848471.042445:0:12940:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787848471.042450:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff93ff520a99d0) has no exports 00000100:00100000:1.0:1787848471.049068:0:9224:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff93ff7fa19600:9224] 4 exiting: rc = 0 00000100:00100000:1.0:1787848471.049238:0:7097:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff93ff52cc7600:7097] 3 exiting: rc = 0 00000100:00100000:1.0:1787848471.049358:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff93ff520e0e00:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1787848471.053404:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff93ff520e0200:5842] 0 exiting: rc = 1 00000100:00100000:2.0:1787848471.053679:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff93ff520e0a00:5844] 2 exiting: rc = 0 00000100:00100000:1.0:1787848471.053856:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053866:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053873:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053880:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053886:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053895:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053903:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053910:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053916:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053922:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053927:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053938:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053944:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053956:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053962:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053968:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053983:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053990:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.053996:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054002:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054034:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054040:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054045:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054052:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054058:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054064:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054069:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054075:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054081:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054098:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054105:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054111:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054117:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054123:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054129:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054134:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054140:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054145:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054151:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054157:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054163:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054169:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054175:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054181:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054187:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054193:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054212:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054217:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054223:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054229:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054235:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054241:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054247:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054252:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054258:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054271:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054276:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054282:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054290:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054296:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054303:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054320:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054330:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.054337:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.067082:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93ff430af000:5845] 0 exiting: rc = 1 00000100:00100000:0.0:1787848471.078001:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93ff4c6b9c00:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1787848471.079339:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.079352:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.079360:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.079367:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.079374:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.079459:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080027:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080037:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080043:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080050:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080056:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080063:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080072:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080079:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080086:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080092:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080098:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080125:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080131:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080138:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080144:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080150:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080156:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080162:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080168:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080174:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080181:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080188:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080194:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080201:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080206:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080213:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080219:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080226:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080232:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080238:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080244:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080251:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080257:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080263:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080269:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080275:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080282:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080287:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080294:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080299:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080305:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080324:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080337:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080344:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080350:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080356:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080370:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080375:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.080997:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.081010:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.081016:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.081021:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.081028:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.081038:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.081046:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.081055:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.081066:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.081078:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.086936:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93ff4c6b8e00:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1787848471.087124:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93ff430afe00:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1787848471.087218:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087230:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087238:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087247:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087255:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087270:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087277:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087285:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087292:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087299:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087318:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087326:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087349:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087357:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087364:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087371:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087380:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087387:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087394:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087401:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087408:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087415:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087423:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087430:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087438:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087446:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087469:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087478:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087484:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087491:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087499:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087505:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087512:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087519:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087535:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087541:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087547:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087554:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087576:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087585:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087592:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087599:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087605:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087613:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087619:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087626:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087632:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087683:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087690:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087698:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087721:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087729:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087735:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087742:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087750:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087757:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087763:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087769:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087776:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087782:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087789:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087797:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087819:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848471.087828:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.117790:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93ff4c644e00:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1787848471.118326:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93ff4c644a00:5850] 1 exiting: rc = 0 00000100:00100000:3.0:1787848471.118536:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118548:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118557:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118564:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118570:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118575:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118582:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118587:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118593:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118599:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118606:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118612:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118619:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118624:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118629:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118634:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118693:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118699:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118706:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118711:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118717:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118722:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118728:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118752:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118757:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118762:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118768:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118774:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118780:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118786:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118791:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118797:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118803:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118810:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118818:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118823:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118829:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118835:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118842:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118849:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118855:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118861:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118867:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118872:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118879:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118885:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118890:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118896:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118902:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118908:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118914:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118920:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118926:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118933:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118940:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118946:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118953:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118958:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118974:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118980:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118986:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118992:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.118997:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.119004:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848471.119949:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93ff4c645800:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1787848471.120173:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93ff4c644800:5852] 1 exiting: rc = 0 00000100:00100000:3.0:1787848471.120271:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120279:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120285:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120291:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120296:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120302:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120318:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120325:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120331:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120337:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120344:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120350:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120356:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120363:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120369:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120375:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120381:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120387:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120392:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120398:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120403:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120409:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120415:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120420:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120425:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120430:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120437:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120443:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120449:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120478:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120485:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120491:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120496:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120501:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120507:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120512:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120517:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120523:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120530:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120535:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120540:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120546:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120552:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120558:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120564:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120570:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120576:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120582:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120588:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120594:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120600:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120606:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120612:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120618:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120624:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120629:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120634:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120660:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120666:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120672:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120678:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120683:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120691:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.120698:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.121918:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff93ff52082e00:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1787848471.122794:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93ff67d82000:5854] 1 exiting: rc = 0 00000100:00100000:3.0:1787848471.123055:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123065:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123071:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123077:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123083:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123089:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123096:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123102:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123108:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123113:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123120:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123126:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123132:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123138:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123144:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123149:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123155:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123161:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123168:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123173:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123179:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123186:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123192:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123199:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123204:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123210:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123216:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123222:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123228:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123235:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123240:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123246:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123252:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123258:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123280:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123287:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123292:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123297:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123303:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123322:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123331:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123342:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123351:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123359:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123365:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123371:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123377:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123384:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123389:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123395:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123401:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123407:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123412:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123419:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123424:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123430:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123435:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123441:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123446:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123452:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123458:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123464:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123707:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.123714:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848471.124552:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff93ff67d83e00:5855] 0 exiting: rc = 1 00000100:00100000:0.0:1787848471.125416:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff93ff67d82200:5857] 2 exiting: rc = 0 00000100:00100000:1.0:1787848471.126251:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93ff67d83200:5856] 1 exiting: rc = 0 00000100:00100000:3.0:1787848471.128232:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128247:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128254:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128261:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128267:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128298:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128320:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128328:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128335:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128341:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128347:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128354:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128360:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128367:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128374:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128422:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128430:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128438:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128445:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128451:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128458:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128464:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128477:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128485:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128492:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128498:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128504:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128510:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128518:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128524:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128531:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128538:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128548:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128556:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128562:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128570:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128577:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128583:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128590:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128611:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128625:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128632:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128659:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128668:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128674:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128681:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128689:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128696:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128702:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128709:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128717:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128724:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128731:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128738:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128746:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128752:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128759:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128766:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128772:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128779:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128787:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128794:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128802:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848471.128809:0:12940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787848471.134543:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787848471.134566:0:12940:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787848471.134575:0:12940:0:(genops.c:885:class_export_put()) final put ffff93ff505c8800/MDS_uuid 00000020:00000080:0.0:1787848471.134582:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff505c8800/MDS_uuid for MDS 00000020:01000000:0.0:1787848471.134589:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787848471.134817:0:12940:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787848471.601049:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848472.626899:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787848473.553880:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787848473.553894:0:7658:0:(genops.c:885:class_export_put()) final put ffff93fe41347000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787848473.553979:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93fe41347000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787848473.554049:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93fe41349000 for lustre-OST0001 00010000:00010000:3.0:1787848473.650742:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787848474.522743:0:13095:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787848474.556502:0:13095:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787848474.556572:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848474.556591:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848474.556790:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848474.556799:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848474.556861:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787848474.556870:0:13095:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787848474.556912:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787848474.556919:0:13095:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787848474.556927:0:13095:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787848474.556966:0:13095:0:(import.c:65:import_set_state_nolock()) ffff93fe413b2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787848474.557057:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874694631420928:0@lo:39:umount.0 00000400:00000100:0.0:1787848474.557137:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874694631420928 offset 0 length 224: 4 00010000:00010000:3.0:1787848474.562799:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848474.562821:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848474.562838:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664400 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848474.562844:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848474.562859:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848474.562893:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848474.562900:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787848474.562902:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787848474.562906:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787848474.563486:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848474.563497:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787848474.563537:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848474.563546:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff50664400/0x9aeb41e0543cb512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aeb41e0543cb519 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848474.563579:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848474.563609:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631421056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848474.563730:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787848474.563806:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848474.563809:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848474.563811:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848474.563921:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631421056 00000100:00100000:1.0:1787848474.563931:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631421056 00000100:00100000:1.0:1787848474.563993:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787848474.564002:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79190f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1874694631421056:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787848474.564009:0:5826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787848474 with bad export cookie 11163088533109649915 00000001:00100000:3.0:1787848474.566056:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787848474.566069:0:6716:0:(genops.c:885:class_export_put()) final put ffff93fe4134f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787848474.566100:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93fe4134f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787848474.566156:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93fe41349800 for lustre-OST0000 00000100:00080000:2.0:1787848474.577523:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787848474.577534:0:3313:0:(import.c:65:import_set_state_nolock()) ffff93ff505ce800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787848474.577541:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1787848474.577634:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79190f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1874694631421056:12345-0@lo:103:ldlm_bl.0 Request processed in 13436us (13709us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787848474.578100:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787848474.591167:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.126@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787848474.591173:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787848474.591183:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ff791921c0 x1874694631421056/t0(0) o103->MGC192.168.201.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787848490 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787848474.591199:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787848474.591202:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787848474.591203:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787848474.591209:0:3313:0:(import.c:65:import_set_state_nolock()) ffff93ff505ce800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787848474.591214:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.201.126@tcp: connect to NID 0@lo last attempt 148 00000100:00080000:2.0:1787848474.591224:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.201.126@tcp: import ffff93ff505ce800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:1.0:1787848474.591906:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff791970c0 x1874694631421184/t0(0) o250->MGC192.168.201.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787848474.591974:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3313:1874694631421056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848474.592032:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3309:1874694631421184:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1787848474.592098:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874694631421184 offset 0 length 520: 4 00010000:00010000:0.0:1787848474.672965:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848474.992431:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848474.992475:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631421312:0@lo:400:kworker.0 00000400:00000100:2.0:1787848474.992580:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874694631421312 offset 0 length 224: 4 00010000:00010000:3.0:1787848475.695976:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848476.724378:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848477.743863:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848478.768678:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848479.791883:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787848480.113987:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) ee9ab6f4-b2e0-4733-95b2-22f99571fbe7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787848480.114002:0:482:0:(pinger.c:247:ptlrpc_pinger_process_import()) ee9ab6f4-b2e0-4733-95b2-22f99571fbe7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787848480.114225:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79195a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631421440:0@lo:400:kworker.0 00000400:00000100:3.0:1787848480.114331:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874694631421440 offset 0 length 224: 4 00010000:00010000:0.0:1787848480.815903:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848481.840194:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848482.863948:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848483.887955:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848484.719833:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787848474/real 1787848474] req@ffff93ff791970c0 x1874694631421184/t0(0) o250->MGC192.168.201.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787848484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848484.719870:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ff791970c0 x1874694631421184/t0(0) o250->MGC192.168.201.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787848484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848484.719882:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787848474/real 1787848474] req@ffff93ff7924b480 x1874694631420928/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787848484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848484.719892:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ff7924b480 x1874694631420928/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787848484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787848484.719910:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff505ce800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787848484.719937:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787848484.719940:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3309:1874694631421184:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1787848484.719946:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93fe413b2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787848484.719971:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874694631420928:0@lo:39:umount.0 00000100:00080000:3.0:1787848484.720160:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) ee9ab6f4-b2e0-4733-95b2-22f99571fbe7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787848484.720175:0:482:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787848484.720180:0:482:0:(import.c:65:import_set_state_nolock()) ffff93ff505ce800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787848484.720189:0:482:0:(import.c:510:import_select_connection()) MGC192.168.201.126@tcp: connect to NID 0@lo last attempt 423 00000100:00080000:3.0:1787848484.720198:0:482:0:(import.c:589:import_select_connection()) MGC192.168.201.126@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787848484.720209:0:482:0:(import.c:624:import_select_connection()) MGC192.168.201.126@tcp: import ffff93ff505ce800 using connection 192.168.201.126@tcp/0@lo 00000100:00080000:1.0:1787848484.720219:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787848484.720225:0:13095:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787848484.720250:0:13095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1787848484.720329:0:482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff7fd5d2c0 x1874694631421568/t0(0) o250->MGC192.168.201.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1787848484.721422:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848484.721451:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848484.721459:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848484.721465:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848484.721494:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787848484.721502:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848484.721509:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848484.721515:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848484.721521:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848484.721533:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787848484.721537:0:13095:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787848484.721561:0:13095:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787848484.721567:0:13095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787848484.721572:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787848484.721592:0:13095:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1787848484.721596:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:1.0:1787848484.721597:0:13095:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93ff7fcc99d0) has no exports 00010000:00010000:0.0:1787848484.721613:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848484.721626:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664800 already unused, calling callback (ffffffffc1b83c20) 00000020:00080000:1.0:1787848484.721633:0:13095:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93ff7fcc99d0) has no exports 10000000:00010000:0.0:1787848484.721633:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848484.721693:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848484.721702:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848484.721709:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787848484.721727:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787848484.721731:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787848484.721753:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ff505ce800 00010000:00010000:0.0:1787848484.721759:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848484.721767:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cb520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb527 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848484.721785:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848484.721789:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848484.721795:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030400 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:0.0:1787848484.721798:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848484.721805:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848484.721811:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848484.721817:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787848484.721819:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787848484.721821:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787848484.721827:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ff505ce800 00010000:00010000:0.0:1787848484.721831:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848484.721837:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cb749 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb750 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848484.721855:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848484.721857:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848484.721859:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848484.721869:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848484.726066:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631421696:0@lo:400:kworker.0 00000400:00000100:3.0:1787848484.726159:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874694631421696 offset 0 length 224: 4 00000100:00100000:0.0:1787848484.726405:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3309:1874694631421568:0@lo:250:kworker.0 00000400:00000100:0.0:1787848484.726442:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874694631421568 offset 0 length 520: 4 00000020:01000000:1.0:1787848484.729671:0:13095:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ff434d83c0 - data ffff93ff7fe73af8/ffff93ff791fd400 00000020:01000000:1.0:1787848484.730471:0:13095:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ff446e6720 - data ffff93ff646fbd80/ffff93fe410ed000 00100000:10000000:1.0:1787848484.754008:0:13095:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787848484.795808:0:13095:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb32f 00000020:00000080:0.0:1787848484.795820:0:13095:0:(genops.c:885:class_export_put()) final put ffff93ff4ed0a800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787848484.795903:0:13095:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ff4314e000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787848484.795907:0:13095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ff4314e000 2 00000020:01000004:0.0:1787848484.795910:0:13095:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93ff4314e000 from lustre-OST0000 00000020:00000080:0.0:1787848484.795937:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787848484.795946:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787848484.795950:0:13095:0:(genops.c:885:class_export_put()) final put ffff93ff4ed0d000/lustre-OST0000_UUID 00000020:00000080:0.0:1787848484.795954:0:13095:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff4ed0d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787848484.795960:0:13095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787848484.796008:0:13095:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787848484.796012:0:13095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787848484.796017:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787848484.796021:0:13095:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787848484.796029:0:13095:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93fe413b0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787848484.796035:0:13095:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff93ff510333a0) has exports, disconnecting them 00000020:00080000:0.0:1787848484.796041:0:13095:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93fe413b0000), last request at 1787848220 00000020:00000080:0.0:1787848484.796044:0:13095:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb359 00000020:00080000:0.0:1787848484.796057:0:13095:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93fe413b0000): rc 0 00000020:00000080:0.0:1787848484.796062:0:13095:0:(genops.c:885:class_export_put()) final put ffff93fe413b0000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787848484.796147:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff4ed0a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787848484.796160:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93fe413b0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787848484.802236:0:13095:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787848484.802247:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787848484.802252:0:13095:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787848484.802260:0:13095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787848484.803156:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787848484.803170:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787848484.803176:0:13095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ff4314e000 1 00000020:00000080:2.0:1787848484.803184:0:13095:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb2e9 00000020:00000080:2.0:1787848484.803193:0:13095:0:(genops.c:885:class_export_put()) final put ffff93ff5f6be800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787848484.807446:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93fe413b2000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787848484.807466:0:482:0:(genops.c:885:class_export_put()) final put ffff93ff81388000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787848484.807470:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff81388000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787848484.807480:0:482:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787848484.807611:0:13095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787848484.807953:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787848484.807973:0:13095:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787848484.808084:0:13095:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff93ff6ee68000) has no exports 00000020:00000080:3.0:1787848484.815310:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f6be800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787848484.834973:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787848484.834989:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787848484.834994:0:13095:0:(genops.c:885:class_export_put()) final put ffff93ff4314c000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787848484.834999:0:13095:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff4314c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787848484.835008:0:13095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787848484.835169:0:13095:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93ff4314c800 00000020:02000400:3.0:1787848484.835483:0:13095:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787848484.972131:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848486.000730:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848487.025736:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787848487.884216:0:13247:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787848487.904233:0:13247:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787848487.904317:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848487.904331:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848487.904338:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848487.904346:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848487.904446:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787848487.904453:0:13247:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787848487.904484:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787848487.904500:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ff7fd5de00 x1874694631421312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848490 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848487.905479:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ff79195a40 x1874694631421440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848496 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848487.905503:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ff7fd5c780 x1874694631421696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848500 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848487.905517:0:13247:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787848487.905524:0:13247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787848487.905553:0:13247:0:(import.c:65:import_set_state_nolock()) ffff93ff5f530800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787848487.905664:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631421312:0@lo:400:kworker.0 00000100:00100000:3.0:1787848487.905708:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79195a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631421440:0@lo:400:kworker.0 00000100:00100000:3.0:1787848487.905731:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874694631421696:0@lo:400:kworker.0 00010000:00010000:0.0:1787848487.907758:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848487.907772:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848487.907785:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031200 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:0.0:1787848487.907790:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848487.907801:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848487.907809:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848487.907815:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787848487.907817:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787848487.907821:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787848487.907837:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ff505ce800 00010000:00010000:0.0:1787848487.907842:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848487.907848:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff40031200/0x9aeb41e0543cb4f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb4fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848487.907860:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848487.907862:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848487.907865:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848487.907887:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874694631421824:0@lo:39:umount.0 00000400:00000100:0.0:1787848487.908124:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874694631421824 offset 0 length 224: 4 00010000:00010000:0.0:1787848488.048061:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848489.071854:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787848489.840160:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ee9ab6f4-b2e0-4733-95b2-22f99571fbe7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787848489.840169:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ee9ab6f4-b2e0-4733-95b2-22f99571fbe7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787848490.096359:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848491.119742:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848492.144132:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848493.167788:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848494.193051:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787848494.959765:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) ee9ab6f4-b2e0-4733-95b2-22f99571fbe7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787848494.959776:0:482:0:(pinger.c:247:ptlrpc_pinger_process_import()) ee9ab6f4-b2e0-4733-95b2-22f99571fbe7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787848495.215805:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848496.239943:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848497.135964:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787848487/real 1787848487] req@ffff93ff7924b480 x1874694631421824/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787848497 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848497.135997:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ff7924b480 x1874694631421824/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787848497 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787848497.136016:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff5f530800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787848497.136037:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874694631421824:0@lo:39:umount.0 00000100:00080000:2.0:1787848497.136116:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787848497.136121:0:13247:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787848497.136126:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787848497.137058:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848497.137073:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848497.137079:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848497.137086:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848497.137127:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787848497.137135:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848497.137142:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848497.137148:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848497.137153:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848497.137193:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787848497.137198:0:13247:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787848497.137225:0:13247:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787848497.137229:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787848497.137233:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787848497.137239:0:13247:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787848497.137244:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93ff79398000) has no exports 00000020:00080000:2.0:1787848497.137266:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93ff79398000) has no exports 00000020:01000000:2.0:1787848497.139059:0:13247:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ff434d89c0 - data ffff93ff7fe73d80/ffff93ff791cd000 00000020:01000000:2.0:1787848497.139191:0:13247:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ff431b0d80 - data ffff93ff7ff7ee58/ffff93ff7fd79000 00010000:00010000:3.0:1787848497.139949:0:12941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787848497.139961:0:12941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848497.139973:0:12941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664e00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848497.139978:0:12941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848497.139991:0:12941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848497.140020:0:12941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848497.140026:0:12941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787848497.140029:0:12941:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787848497.140032:0:12941:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787848497.140050:0:12941:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ff505ce800 00010000:00010000:3.0:1787848497.140054:0:12941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848497.140062:0:12941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cb504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb50b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848497.140074:0:12941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848497.140079:0:12941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848497.140085:0:12941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236000 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848497.140089:0:12941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848497.140096:0:12941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848497.140103:0:12941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848497.140108:0:12941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787848497.140110:0:12941:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787848497.140120:0:12941:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787848497.140127:0:12941:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ff505ce800 00010000:00010000:3.0:1787848497.140130:0:12941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848497.140137:0:12941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff79236000/0x9aeb41e0543cb73b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb742 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848497.140153:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848497.140155:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848497.140157:0:12941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848497.140482:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787848497.146397:0:13247:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787848497.193091:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb3fa 00000020:00000080:1.0:1787848497.193269:0:13247:0:(genops.c:885:class_export_put()) final put ffff93ff79394800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787848497.193320:0:13247:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93fe41342800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787848497.193325:0:13247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93fe41342800 2 00000020:01000004:1.0:1787848497.193329:0:13247:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93fe41342800 from lustre-OST0001 00000020:00000080:1.0:1787848497.193357:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787848497.193369:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787848497.193372:0:13247:0:(genops.c:885:class_export_put()) final put ffff93ff79396000/lustre-OST0001_UUID 00000020:00000080:1.0:1787848497.193375:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff79396000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787848497.193381:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787848497.193722:0:13247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ee9ab6f4-b2e0-4733-95b2-22f99571fbe7->MGS 00010000:00010000:1.0:1787848497.193738:0:13247:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff40031400/0x9aeb41e0543cb30c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb313 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848497.193752:0:13247:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff40031400/0x9aeb41e0543cb30c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb313 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848497.193759:0:13247:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787848497.193761:0:13247:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787848497.193764:0:13247:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787848497.193778:0:13247:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ff505ce800 00010000:00010000:1.0:1787848497.193782:0:13247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff40031400/0x9aeb41e0543cb30c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb313 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848497.193799:0:13247:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb54a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aeb41e0543cb551 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848497.193817:0:13247:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb54a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aeb41e0543cb551 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848497.193823:0:13247:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787848497.193826:0:13247:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787848497.193827:0:13247:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787848497.193836:0:13247:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ff505ce800 00010000:00010000:1.0:1787848497.193839:0:13247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff414a5c00/0x9aeb41e0543cb54a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aeb41e0543cb551 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787848497.193865:0:13247:0:(import.c:65:import_set_state_nolock()) ffff93ff505ce800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787848497.193872:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787848497.193874:0:13247:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787848497.193876:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787848497.193879:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787848497.193892:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ff7fd5d2c0 x1874694631421568/t0(0) o250->MGC192.168.201.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787848499 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787848497.193950:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787848497.193954:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:3.0:1787848497.194057:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff79394800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1787848497.194399:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee9ab6f4-b2e0-4733-95b2-22f99571fbe7:3309:1874694631421568:0@lo:250:kworker.0 10000000:01000000:1.0:1787848497.194453:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787848497.194462:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb1ed 00000020:00000080:1.0:1787848497.194468:0:13247:0:(genops.c:885:class_export_put()) final put ffff93ff505cc800/ee9ab6f4-b2e0-4733-95b2-22f99571fbe7 00000020:01000000:1.0:1787848497.194481:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.126@tcp (flags='') 00000020:00000080:1.0:1787848497.194486:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787848497.194946:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff505cc800/ee9ab6f4-b2e0-4733-95b2-22f99571fbe7 for MGC192.168.201.126@tcp 00000020:00000080:1.0:1787848497.195002:0:13247:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.126@tcp: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787848497.195007:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff93ff520ab3a0) has no exports 10000000:01000000:3.0:1787848497.195842:0:5839:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787848497.195912:0:13247:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.126@tcp: client import never connected 00000100:00080000:1.0:1787848497.195916:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787848497.195919:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787848497.195923:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787848497.195937:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787848497.196231:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787848497.196238:0:13247:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.126@tcp (uuid ee9ab6f4-b2e0-4733-95b2-22f99571fbe7) 00000020:01000000:1.0:1787848497.196245:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787848497.196249:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787848497.196253:0:13247:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787848497.196262:0:13247:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93ff5f531000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787848497.196268:0:13247:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff93ff510319d0) has exports, disconnecting them 00000020:00080000:1.0:1787848497.196273:0:13247:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93ff5f531000), last request at 1787848243 00000020:00000080:1.0:1787848497.196277:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb424 00000020:00080000:1.0:1787848497.196291:0:13247:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ff5f531000): rc 0 00000020:00000080:1.0:1787848497.196295:0:13247:0:(genops.c:885:class_export_put()) final put ffff93ff5f531000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787848497.196388:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f531000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787848497.198440:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff505ce800 for MGC192.168.201.126@tcp 00000020:00000080:3.0:1787848497.198454:0:482:0:(genops.c:885:class_export_put()) final put ffff93ff58cf8000/ee9ab6f4-b2e0-4733-95b2-22f99571fbe7 00000020:00000080:3.0:1787848497.198457:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff58cf8000/ee9ab6f4-b2e0-4733-95b2-22f99571fbe7 for MGC192.168.201.126@tcp 00000020:01000000:3.0:1787848497.198464:0:482:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.126@tcp (ee9ab6f4-b2e0-4733-95b2-22f99571fbe7) 00010000:01000000:0.0:1787848497.198977:0:13247:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787848497.198983:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787848497.198987:0:13247:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787848497.198993:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787848497.199048:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787848497.199227:0:12941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:3.0:1787848497.199297:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93ff5f530800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1787848497.199929:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787848497.200748:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93ff43165c00:5824] 0 exiting: rc = 1 00000100:00100000:0.0:1787848497.201830:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93ff42de8c00:5825] 1 exiting: rc = 0 00000100:00100000:3.0:1787848497.201963:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.202244:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93ff511c0400:5827] 1 exiting: rc = 0 00000100:00100000:0.0:1787848497.202310:0:8522:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93ff6eda2000:8522] 3 exiting: rc = 0 00000100:00100000:0.0:1787848497.202362:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93ff42de9a00:5826] 0 exiting: rc = 1 00000100:00100000:1.0:1787848497.202679:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93ff4463fa00:5828] 2 exiting: rc = 0 00000100:00100000:3.0:1787848497.202937:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.202945:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.202951:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.202957:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.202963:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.202980:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.202990:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203043:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203049:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203054:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203060:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203065:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203073:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203080:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203086:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203103:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203110:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203116:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203121:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203125:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203130:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203135:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203140:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203145:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203150:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203155:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203161:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203462:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203468:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203473:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203479:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203485:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203743:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203751:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203757:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203762:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203766:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203771:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203776:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203782:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203798:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203804:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203809:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203814:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203819:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203823:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203828:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203833:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203837:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203843:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203848:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203863:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203868:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203873:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203877:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203882:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203887:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203891:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203895:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203900:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203905:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203910:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203916:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.203920:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787848497.205414:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787848497.205425:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787848497.205432:0:13247:0:(genops.c:885:class_export_put()) final put ffff93ff515f5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787848497.205436:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff515f5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787848497.205441:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787848497.205481:0:13247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93fe41342800 1 00000020:00000080:3.0:1787848497.205487:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aeb41e0543cb3c9 00000020:00000080:3.0:1787848497.205509:0:13247:0:(genops.c:885:class_export_put()) final put ffff93ff8048a000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787848497.205626:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787848497.205632:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787848497.205665:0:13247:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787848497.205669:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff93ff6ee6cd70) has no exports 00000020:00000080:0.0:1787848497.206317:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff8048a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787848497.243250:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787848497.243281:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787848497.243287:0:13247:0:(genops.c:885:class_export_put()) final put ffff93fe41346800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787848497.243292:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff93fe41346800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787848497.243303:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787848497.243607:0:13247:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93fe41345800 00000020:01000000:0.0:1787848497.243631:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787848497.243635:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787848497.243658:0:13247:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787848497.243662:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff93ff520a8000) has no exports 00000020:00000080:0.0:1787848497.243687:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787848497.243693:0:13247:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787848497.243697:0:13247:0:(genops.c:885:class_export_put()) final put ffff93ff5f6bd000/OSS_uuid 00000020:00000080:0.0:1787848497.243699:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff93ff5f6bd000/OSS_uuid for OSS 00000020:01000000:0.0:1787848497.243703:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787848497.243891:0:11455:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff93ff43011a00:11455] 3 exiting: rc = 0 00000100:00100000:3.0:1787848497.245723:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93ff7a46b000:6690] 1 exiting: rc = 0 00000100:00100000:3.0:1787848497.245795:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff93ff7a46b400:6691] 2 exiting: rc = 0 00000100:00080000:3.0:1787848497.245836:0:5838:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787848497.247722:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff93ff45771a00:6689] 0 exiting: rc = 1 00000100:00100000:0.0:1787848497.247851:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247869:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247877:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247883:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247888:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247893:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247898:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247972:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247977:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247983:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247989:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247994:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.247999:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248004:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248009:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248014:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248018:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248024:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248028:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248033:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248052:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248057:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248064:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248069:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248074:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248079:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248084:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248089:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248094:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248100:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248105:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248111:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248116:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248122:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248127:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248132:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248137:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248142:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248148:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248153:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248158:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248229:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248238:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248242:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248247:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248251:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248256:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248262:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248268:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248273:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248277:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248282:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248287:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248292:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248301:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248314:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248319:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248324:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248330:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248334:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248339:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248344:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248349:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.248354:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.250020:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93ff4476f800:6693] 0 exiting: rc = 1 00000100:00100000:0.0:1787848497.250126:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93ff504cb600:6694] 1 exiting: rc = 0 00000100:00100000:0.0:1787848497.250239:0:11150:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff93ff44662a00:11150] 2 exiting: rc = 0 00000100:00100000:0.0:1787848497.250294:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250302:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250307:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250312:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250317:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250323:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250328:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250334:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250339:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250344:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250349:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250355:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250360:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250365:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250370:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250375:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250380:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250385:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250390:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250395:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250400:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250405:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250410:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250415:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250432:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250437:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250443:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250449:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250454:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250459:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250463:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250467:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250472:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250476:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250481:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.250486:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252722:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252767:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252773:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252778:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252784:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252789:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252794:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252799:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252804:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252808:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252813:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252818:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252824:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252829:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252833:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252839:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252844:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252849:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252863:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252869:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252874:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252878:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252883:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252965:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252972:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252977:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252983:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.252988:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.254466:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93ff7a46ae00:6697] 2 exiting: rc = 0 00000100:00100000:0.0:1787848497.254835:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93ff8139f000:6696] 1 exiting: rc = 0 00000100:00100000:3.0:1787848497.255273:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93ff8139f800:6695] 0 exiting: rc = 1 00000100:00100000:0.0:1787848497.256468:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256477:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256484:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256501:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256516:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256523:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256528:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256534:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256539:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256544:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256550:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256555:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256561:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256567:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256573:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256578:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256583:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256588:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256600:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256606:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256611:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256617:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256622:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256627:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.256632:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259567:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259594:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259600:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259624:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259754:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259762:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259767:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259772:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259778:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259784:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259789:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259794:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259799:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259805:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259810:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259816:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259821:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259827:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259832:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259838:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259844:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.259850:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265370:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265387:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265393:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265398:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265403:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265409:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265444:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265451:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265456:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265462:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265476:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.265483:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.266598:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.266617:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.266624:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.266630:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.267355:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787848497.294754:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93ff79432200:6699] 1 exiting: rc = 0 00000100:00100000:3.0:1787848497.295911:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93ff802f1a00:6698] 0 exiting: rc = 1 00000100:00100000:0.0:1787848497.296054:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296062:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296072:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296078:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296082:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296087:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296092:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296097:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296102:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296108:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296113:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296118:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296123:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296128:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296134:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296139:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296145:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296150:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296155:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296160:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296165:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296170:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296176:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296182:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296187:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296192:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296198:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296203:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296208:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296214:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296220:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296225:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296230:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296234:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296253:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296258:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296264:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296269:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296274:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296280:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296284:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296289:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296300:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296306:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296310:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296316:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296323:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296328:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296333:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296342:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296347:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296358:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296363:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296369:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296374:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296379:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296386:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296391:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296396:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296401:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296406:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296410:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296416:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787848497.296421:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787848497.297528:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93ff7a46b800:6701] 1 exiting: rc = 0 00000100:00100000:0.0:1787848497.297626:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93ff7a46b600:6700] 0 exiting: rc = 1 00000100:00100000:3.0:1787848497.306530:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306544:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306553:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306560:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306566:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306572:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306578:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306594:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306604:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306611:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306618:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306625:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306630:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306689:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306696:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306702:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306708:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306714:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306720:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306726:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306732:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306910:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306920:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306928:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306933:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306965:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306972:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306978:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306984:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306990:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.306996:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307003:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307009:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307015:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307022:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307027:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307033:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307052:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307059:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307064:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307070:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307080:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307086:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307106:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307113:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307120:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307127:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307133:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307139:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307160:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307176:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307182:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307188:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307194:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307200:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307206:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307214:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307227:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307233:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307239:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307250:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307263:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307280:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787848497.307292:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787848497.325268:0:13247:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787848515.228144:0:13865:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787848523.887430:0:14325:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787848523.888589:0:14325:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787848523.888744:0:14325:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93ff5ede2000 00000020:01000004:3.0:1787848523.888761:0:14325:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787848523.888769:0:14325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787848523.888784:0:14325:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93ff7fcccd70) 00000020:00000080:3.0:1787848523.888797:0:14325:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787848523.909848:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787848523.912512:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787848523.913161:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 445: rc = 0 00100000:10000000:2.0:1787848523.913430:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787848523.913497:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 445: rc = 0 00100000:10000000:2.0:1787848523.913900:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 445: rc = 0 00100000:10000000:2.0:1787848523.914000:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 445: rc = 0 00100000:10000000:2.0:1787848523.914162:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 445: rc = 0 00100000:10000000:2.0:1787848523.914255:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 445: rc = 0 00100000:10000000:2.0:1787848523.914594:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 447: rc = 0 00100000:10000000:2.0:1787848523.916446:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 488: rc = 0 00100000:10000000:2.0:1787848523.916545:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 488: rc = 0 00100000:10000000:2.0:1787848523.917436:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 341: rc = 0 00100000:10000000:2.0:1787848523.917923:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 341: rc = 0 00100000:10000000:2.0:1787848523.918235:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 341: rc = 0 00100000:10000000:2.0:1787848523.918586:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 341: rc = 0 00100000:10000000:2.0:1787848523.919201:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 341: rc = 0 00100000:10000000:2.0:1787848523.919513:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 341: rc = 0 00100000:10000000:2.0:1787848523.919984:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 341: rc = 0 00100000:10000000:2.0:1787848523.920454:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 341: rc = 0 00100000:10000000:2.0:1787848523.920960:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 341: rc = 0 00100000:10000000:2.0:1787848523.921364:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 341: rc = 0 00100000:10000000:2.0:1787848523.921636:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 341: rc = 0 00100000:10000000:2.0:1787848523.922362:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 341: rc = 0 00100000:10000000:2.0:1787848523.923123:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 359: rc = 0 00100000:10000000:2.0:1787848523.923458:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 359: rc = 0 00100000:10000000:2.0:1787848523.923862:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 359: rc = 0 00100000:10000000:2.0:1787848523.924511:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 359: rc = 0 00100000:10000000:2.0:1787848523.924958:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 359: rc = 0 00100000:10000000:2.0:1787848523.925413:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 359: rc = 0 00100000:10000000:2.0:1787848523.925977:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 359: rc = 0 00100000:10000000:2.0:1787848523.926382:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 359: rc = 0 00100000:10000000:2.0:1787848523.926860:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 359: rc = 0 00100000:10000000:2.0:1787848523.927238:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 359: rc = 0 00100000:10000000:2.0:1787848523.927565:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 359: rc = 0 00100000:10000000:2.0:1787848523.928271:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 359: rc = 0 00100000:10000000:2.0:1787848523.928601:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 359: rc = 0 00100000:10000000:2.0:1787848523.929155:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 359: rc = 0 00100000:10000000:2.0:1787848523.929491:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 359: rc = 0 00100000:10000000:2.0:1787848523.930103:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 359: rc = 0 00100000:10000000:2.0:1787848523.930463:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 359: rc = 0 00100000:10000000:2.0:1787848523.930935:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 359: rc = 0 00100000:10000000:2.0:1787848523.931515:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 359: rc = 0 00100000:10000000:2.0:1787848523.931957:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 359: rc = 0 00100000:10000000:2.0:1787848523.932482:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 359: rc = 0 00100000:10000000:2.0:1787848523.933155:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 359: rc = 0 00100000:10000000:2.0:1787848523.933498:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 359: rc = 0 00100000:10000000:2.0:1787848523.934174:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 359: rc = 0 00100000:10000000:2.0:1787848523.934510:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 359: rc = 0 00100000:10000000:2.0:1787848523.935004:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 359: rc = 0 00100000:10000000:2.0:1787848523.935387:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 359: rc = 0 00100000:10000000:2.0:1787848523.935949:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 359: rc = 0 00100000:10000000:2.0:1787848523.936343:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 359: rc = 0 00100000:10000000:2.0:1787848523.936610:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 359: rc = 0 00100000:10000000:2.0:1787848523.937173:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 359: rc = 0 00100000:10000000:2.0:1787848523.937502:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 359: rc = 0 00100000:10000000:2.0:1787848523.938211:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 355: rc = 0 00100000:10000000:2.0:1787848523.939094:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787848523.939271:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 489: rc = 0 00100000:10000000:2.0:1787848523.939551:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787848523.939616:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 489: rc = 0 00100000:10000000:2.0:1787848523.940149:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787848523.940214:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 489: rc = 0 00100000:10000000:2.0:1787848523.940869:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787848523.940946:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 493: rc = 0 00100000:10000000:2.0:1787848523.941580:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787848523.941842:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 493: rc = 0 00100000:10000000:2.0:1787848523.942052:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787848523.942118:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 493: rc = 0 00000020:00000080:3.0:1787848523.942883:0:14325:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787848523.942892:0:14325:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787848523.942902:0:14325:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cc4ee 00000020:01000004:3.0:1787848523.942910:0:14325:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787848523.942914:0:14325:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787848523.942919:0:14325:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93ff5ede2000 from MGS 00000020:01000004:3.0:1787848523.942923:0:14325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787848523.942933:0:14325:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93ff7fccb3a0) 00000020:00000080:3.0:1787848523.942945:0:14325:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787848523.942996:0:14325:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ff5ede2000 from MGS, refs=2 00080000:01000000:3.0:1787848523.943001:0:14325:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787848523.943006:0:14325:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cc4fc 00000100:00100000:3.0:1787848523.943163:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787848523.943357:0:14325:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787848523.943364:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787848523.944161:0:14325:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787848523.944168:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787848523.945104:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787848523.945267:0:14325:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787848523.945339:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787848523.945984:0:14325:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787848523.945991:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787848523.946414:0:14325:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787848523.946421:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787848523.947400:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848523.947404:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848523.947406:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848523.947981:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848523.947984:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848523.947986:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848523.948556:0:14325:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787848523.956367:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787848523.960087:0:14325:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787848523.960106:0:14325:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787848523.960109:0:14325:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787848523.962540:0:14334:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787848523.962952:0:14325:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787848523.963383:0:14325:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787848523.965402:0:14325:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787848523.966411:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787848523.966603:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787848523.966609:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787848523.968339:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787848523.968350:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787848523.975492:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787848523.975508:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787848523.976555:0:14325:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787848523.976576:0:14325:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.126@tcp' 00000020:01000004:3.0:1787848523.976578:0:14325:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787848523.976609:0:14325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.126@tcp (typ=mgc) 00000020:00000080:3.0:1787848523.976621:0:14325:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.126@tcp (ffff93ff7fcc99d0) 00000020:00000080:3.0:1787848523.976635:0:14325:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787848523.977001:0:14325:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93fe41349800@MGC192.168.201.126@tcp: add connection 192.168.201.126@tcp at head 00010000:00010000:3.0:1787848523.977216:0:14325:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.126@tcp-0 is initialized 00000040:01000000:3.0:1787848523.977223:0:14325:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787848523.977897:0:14340:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787848523.977964:0:14325:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.126@tcp (uuid 0ee33ef1-6a45-464a-a8ac-d296b849f06b) 00000020:00000080:0.0:1787848523.977981:0:14325:0:(genops.c:1385:class_connect()) connect: client 0ee33ef1-6a45-464a-a8ac-d296b849f06b, cookie 0x9aeb41e0543cc50a 00000100:00080000:0.0:1787848523.977991:0:14325:0:(import.c:510:import_select_connection()) MGC192.168.201.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787848523.978003:0:14325:0:(import.c:624:import_select_connection()) MGC192.168.201.126@tcp: import ffff93fe41349800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:0.0:1787848523.978044:0:14325:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff79193840 x1874694631421952/t0(0) o250->MGC192.168.201.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787848523.978067:0:14325:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0ee33ef1-6a45-464a-a8ac-d296b849f06b->MGS 00000020:01000004:0.0:1787848523.978092:0:14325:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787848523.978098:0:14325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787848523.978110:0:14325:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93ff7939cd70) 00000020:00000080:0.0:1787848523.978120:0:14325:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1787848523.978603:0:14339:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1787848523.978858:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79193840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3309:1874694631421952:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787848523.978939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848523.980879:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631421952 00000100:00100000:1.0:1787848523.980890:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631421952 00000100:00100000:1.0:1787848523.980924:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787848523.980931:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874694631421952:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787848523.980958:0:14336:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 0ee33ef1-6a45-464a-a8ac-d296b849f06b@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1787848523.980987:0:14336:0:(genops.c:1385:class_connect()) connect: client 0ee33ef1-6a45-464a-a8ac-d296b849f06b, cookie 0x9aeb41e0543cc518 00000100:00080000:1.0:1787848523.981129:0:14336:0:(import.c:65:import_set_state_nolock()) ffff93ff7922d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787848523.981208:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+5:3309:x1874694631421952:12345-0@lo:250:mount.lustre.0 Request processed in 275us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848523.981215:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787848523.981257:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787848523.981266:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.126@tcp: connect to target with instance 0 00000100:00080000:1.0:1787848523.981282:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787848523.981286:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787848523.981290:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93fe41349800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787848523.981292:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787848523.981307:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787848523.981313:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79193840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3309:1874694631421952:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787848524.000963:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787848524.001173:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787848524.001179:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787848524.003901:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787848524.003914:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787848524.004302:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787848524.004308:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787848524.005198:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787848524.005902:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787848524.005908:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787848524.006434:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787848524.006441:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787848524.067529:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787848524.067756:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787848524.067764:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787848524.071957:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787848524.071979:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787848524.072719:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787848524.073105:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787848524.073111:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787848524.074453:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787848524.074462:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787848524.075127:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787848524.075291:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787848524.075296:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787848524.076260:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787848524.076269:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787848524.077177:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787848524.077341:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787848524.077346:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787848524.078253:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787848524.078262:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787848524.105004:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787848524.105210:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787848524.105216:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787848524.119198:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787848524.119221:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787848524.120879:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787848524.120893:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787848524.131331:0:14325:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787848524.131359:0:14325:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787848524.131366:0:14325:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787848524.131516:0:14325:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787848524.131552:0:14325:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.126@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787848524.131556:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787848524.131558:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787848524.131559:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787848524.131561:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787848524.131562:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787848524.131564:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787848524.131569:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787848524.131571:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787848524.131572:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787848524.131574:0:14325:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787848524.131577:0:14325:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787848524.131579:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787848524.131580:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787848524.131581:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787848524.131582:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787848524.131583:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787848524.131584:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787848524.131585:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787848524.131586:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787848524.131587:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787848524.131588:0:14325:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787848524.131612:0:14325:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787848524.131636:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422080:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787848524.131896:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848524.131948:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6f8eaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848524.132124:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631422080 00000100:00100000:1.0:1787848524.132131:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631422080 00000100:00100000:1.0:1787848524.132183:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787848524.132193:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+5:14325:x1874694631422080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787848524.132284:0:14338:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787848524.132289:0:14338:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787848524.132292:0:14338:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787848524.132621:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787848524.133478:0:14338:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787848524.135881:0:14360:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787848524.135890:0:14360:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787848524.135892:0:14360:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787848524.135928:0:14360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787848524.136352:0:14338:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787848524.136364:0:14338:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787848524.149372:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+5:14325:x1874694631422080:12345-0@lo:253:mount.lustre.0 Request processed in 17170us (17465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848524.149402:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787848524.149490:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422080:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787848524.149506:0:14325:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787848524.149510:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787848524.149512:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787848524.149513:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787848524.149514:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787848524.149515:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787848524.149516:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787848524.149518:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787848524.149519:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787848524.149533:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787848524.149534:0:14325:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787848524.149554:0:14325:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93ff5ede2000 from lustre-MDT0000 10000000:01000000:1.0:1787848524.149593:0:14325:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787848524.149597:0:14325:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787848524.149606:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93ff7fcc99d0 10000000:01000000:1.0:1787848524.149613:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787848524.149620:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93ff7fcc99d0 from 1 10000000:01000000:1.0:1787848524.149623:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787848524.150142:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.150214:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.150225:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848524.150245:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79194780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787848524.150288:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848524.150368:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5821a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848524.150421:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631422208 00000100:00100000:0.0:1787848524.150428:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631422208 00000100:00100000:0.0:1787848524.150508:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787848524.150518:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4579ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+5:14325:x1874694631422208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787848524.150531:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848524.150545:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cc526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc51f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.150567:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cc526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc51f expref: 6 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.150586:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40031600/0x9aeb41e0543cc526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc51f expref: 6 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.150595:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40031600, rc 0) 00000100:00100000:0.0:1787848524.150668:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4579ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+6:14325:x1874694631422208:12345-0@lo:101:mount.lustre.0 Request processed in 152us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848524.150686:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787848524.150835:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79194780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787848524.150852:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc526 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.150862:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc526 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848524.150918:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848524.150945:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848524.151262:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff50d32300 going to sleep for 11 seconds 00000100:00100000:1.0:1787848524.151407:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631422336 00000100:00100000:1.0:1787848524.151412:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631422336 00000100:00100000:1.0:1787848524.151438:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787848524.151444:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4579b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+6:14325:x1874694631422336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787848524.151707:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4579b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+6:14325:x1874694631422336:12345-0@lo:501:mount.lustre.0 Request processed in 261us (760us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787848524.151714:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787848524.151898:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422336:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787848524.151929:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787848524.151959:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc526 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.152124:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc526 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848524.152133:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ff5ede2000 10000000:01000000:2.0:1787848524.152224:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787848524.152230:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93ff5ede2000 10000000:01000000:2.0:1787848524.152232:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787848524.152236:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93ff5ede2000 from 1 10000000:01000000:2.0:1787848524.152239:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787848524.152264:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cc52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.152283:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cc52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.152292:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cc52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848524.152307:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787848524.152339:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848524.152373:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff50d32300 going to sleep for 11 seconds 00000100:00100000:1.0:1787848524.152498:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631422464 00000100:00100000:1.0:1787848524.152503:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631422464 00000100:00100000:1.0:1787848524.152530:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787848524.152535:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+6:14325:x1874694631422464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787848524.152544:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848524.152558:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff5f42f800/0x9aeb41e0543cc534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc52d expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.152576:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff5f42f800/0x9aeb41e0543cc534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc52d expref: 7 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.152584:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff5f42f800/0x9aeb41e0543cc534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc52d expref: 7 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.152591:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f800, rc 0) 00000100:00100000:1.0:1787848524.152629:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+7:14325:x1874694631422464:12345-0@lo:101:mount.lustre.0 Request processed in 93us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848524.152634:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787848524.152869:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787848524.152881:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cc52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc534 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.152890:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cc52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc534 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848524.152904:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787848524.152915:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cc52d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc534 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.152922:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50664000/0x9aeb41e0543cc52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc534 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848524.152929:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787848524.152943:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787848524.152948:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93ff5ede2000 10000000:01000000:2.0:1787848524.152951:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787848524.152960:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787848524.153141:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787848524.153224:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665a00/0x9aeb41e0543cc53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.153231:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50665a00/0x9aeb41e0543cc53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.153237:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50665a00/0x9aeb41e0543cc53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848524.153251:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787848524.153283:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848524.153450:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff50d32300 going to sleep for 11 seconds 00000100:00100000:0.0:1787848524.153502:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631422592 00000100:00100000:0.0:1787848524.153507:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631422592 00000100:00100000:0.0:1787848524.153535:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787848524.153541:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+7:14325:x1874694631422592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787848524.153549:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848524.153560:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40030a00/0x9aeb41e0543cc542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc53b expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.153576:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40030a00/0x9aeb41e0543cc542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc53b expref: 8 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.153584:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40030a00/0x9aeb41e0543cc542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc53b expref: 8 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.153591:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40030a00, rc 0) 00000100:00100000:0.0:1787848524.153632:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+8:14325:x1874694631422592:12345-0@lo:101:mount.lustre.0 Request processed in 92us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848524.153657:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787848524.153793:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787848524.153805:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50665a00/0x9aeb41e0543cc53b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc542 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.153813:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50665a00/0x9aeb41e0543cc53b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc542 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848524.153862:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848524.153887:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848524.153907:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff50d32300 going to sleep for 11 seconds 00000100:00100000:0.0:1787848524.154234:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631422720 00000100:00100000:0.0:1787848524.154239:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631422720 00000100:00100000:0.0:1787848524.154272:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787848524.154279:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+8:14325:x1874694631422720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787848524.154890:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+9:14325:x1874694631422720:12345-0@lo:501:mount.lustre.0 Request processed in 610us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848524.154899:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787848524.155015:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848524.155066:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787848524.155107:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848524.155156:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff50d32300 going to sleep for 11 seconds 00000100:00100000:0.0:1787848524.155410:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631422848 00000100:00100000:0.0:1787848524.155415:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631422848 00000100:00100000:0.0:1787848524.155440:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787848524.155447:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+9:14325:x1874694631422848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787848524.155890:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+9:14325:x1874694631422848:12345-0@lo:503:mount.lustre.0 Request processed in 442us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848524.155897:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848524.156244:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631422848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787848524.157399:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14361:1874694631422976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848524.157463:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848524.157533:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff50d32d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787848524.157573:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631422976 00000100:00100000:0.0:1787848524.157579:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631422976 00000100:00100000:0.0:1787848524.157689:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787848524.157867:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+9:14361:x1874694631422976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848524.158444:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+9:14361:x1874694631422976:12345-0@lo:502:llog_process_th.0 Request processed in 745us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848524.158454:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787848524.158548:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14361:1874694631422976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787848524.158577:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787848524.158589:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848524.158591:0:14361:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787848524.158597:0:14361:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787848524.158600:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787848524.158613:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93ff6ee6b3a0) 00000020:00000080:2.0:1787848524.158630:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787848524.158634:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787848524.158738:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787848524.158745:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cc550 00000020:00000080:2.0:1787848524.158949:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787848524.158954:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848524.158957:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848524.158959:0:14361:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787848524.158978:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787848524.158983:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848524.158984:0:14361:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787848524.158988:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787848524.158996:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93ff6ee6cd70) 00000020:00000080:2.0:1787848524.159115:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787848524.159122:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787848524.159123:0:14361:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787848524.159126:0:14361:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787848524.159132:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787848524.159195:0:14361:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ff5ede2000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787848524.159208:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93ff6ee68000) 00000020:00000080:2.0:1787848524.159215:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787848524.159256:0:14361:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787848524.159261:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aeb41e0543cc565 00000020:00000080:2.0:1787848524.159348:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787848524.159355:0:14361:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787848524.159359:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9aeb41e0543cc56c 00080000:01000000:2.0:1787848524.159363:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787848524.159366:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cc573 00010000:00010000:3.0:1787848524.245906:0:14361:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787848524.247886:0:14361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787848524.248623:0:14361:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787848524.251865:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93ff7fcc8000) 00000020:00000080:3.0:1787848524.251888:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787848524.253559:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787848524.253577:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cc581 00000020:00000080:3.0:1787848524.279755:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787848524.288541:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9aeb41e0543cc588 00000020:00000080:2.0:1787848524.292114:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787848524.292132:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848524.292186:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848524.292189:0:14361:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787848524.292193:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787848524.292196:0:14361:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787848524.292197:0:14361:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787848524.292199:0:14361:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787848524.292200:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787848524.292203:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848524.292205:0:14361:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787848524.292207:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787848524.292212:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848524.292213:0:14361:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787848524.292217:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787848524.292358:0:14361:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787848524.292401:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848524.292405:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848524.292407:0:14361:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787848524.292410:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787848524.292413:0:14361:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787848524.292416:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848524.292493:0:14361:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787848524.292498:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787848524.292503:0:14361:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.126@tcp to nid 0x20000c0a8c97e (192.168.201.126@tcp) 00000020:01000000:2.0:1787848524.292533:0:14361:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787848524.292536:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787848524.292554:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93ff6ee699d0) 00000020:00000080:2.0:1787848524.292572:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787848524.292578:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787848524.292662:0:14361:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787848524.292667:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787848524.292866:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cc596 00010000:00080000:2.0:1787848524.292900:0:14361:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ff79217800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:2.0:1787848524.293846:0:14361:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787848524.295597:0:14361:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787848524.296927:0:14361:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787848524.303426:0:14361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787848524.303607:0:14361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787848524.304544:0:14361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787848524.305940:0:14365:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787848524.305947:0:14365:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787848524.307601:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787848524.307617:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787848524.307925:0:14361:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787848524.307945:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aeb41e0543cc59d 00000100:00080000:3.0:1787848524.307955:0:14361:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787848524.308197:0:14361:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ff79217800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787848524.308233:0:14361:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff7fd5c000 x1874694631423104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787848524.308319:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631423104:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787848524.308376:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874694631423104 offset 0 length 520: 4 00000100:00080000:3.0:1787848524.308630:0:14361:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787848524.308897:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848524.308903:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848524.308906:0:14361:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787848524.308910:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787848524.308913:0:14361:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787848524.308914:0:14361:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787848524.308916:0:14361:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787848524.308917:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787848524.308920:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848524.308922:0:14361:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787848524.308924:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787848524.308928:0:14361:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787848524.308932:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848524.308933:0:14361:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787848524.308937:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787848524.308941:0:14361:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.126@tcp to nid 0x20000c0a8c97e (192.168.201.126@tcp) 00000020:01000000:3.0:1787848524.308974:0:14361:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787848524.308977:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787848524.309090:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93ff8146cd70) 00000020:00000080:3.0:1787848524.309108:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787848524.309119:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787848524.309251:0:14361:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787848524.309258:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787848524.309329:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aeb41e0543cc5ab 00010000:00080000:3.0:1787848524.309360:0:14361:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ff80247800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:3.0:1787848524.309909:0:14361:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787848524.310884:0:14361:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787848524.310915:0:14361:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787848524.312911:0:14361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787848524.313264:0:14361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787848524.313557:0:14361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787848524.314475:0:14367:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787848524.314481:0:14367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787848524.315914:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787848524.315929:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787848524.315975:0:14361:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787848524.316014:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aeb41e0543cc5b2 00000100:00080000:3.0:1787848524.316027:0:14361:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787848524.316034:0:14361:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ff80247800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787848524.316070:0:14361:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff7fd5da40 x1874694631423232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787848524.316099:0:14361:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787848524.316502:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848524.316509:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848524.316511:0:14361:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787848524.316515:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787848524.316520:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848524.316521:0:14361:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787848524.316524:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787848524.316526:0:14361:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787848524.316528:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848524.316531:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848524.316533:0:14361:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787848524.316547:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787848524.316551:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848524.316553:0:14361:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787848524.316556:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787848524.316595:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14361:1874694631423360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848524.316803:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631423232:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787848524.317593:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874694631423232 offset 0 length 520: 4 00000100:00100000:3.0:1787848524.318258:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848524.318409:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff44eec180 going to sleep for 11 seconds 00000100:00100000:1.0:1787848524.318514:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631423360 00000100:00100000:1.0:1787848524.318522:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631423360 00000100:00100000:1.0:1787848524.318607:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787848524.318617:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+9:14361:x1874694631423360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848524.319547:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14361:1874694631423360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787848524.319586:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848524.319593:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848524.319596:0:14361:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787848524.319602:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787848524.319997:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787848524.320025:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787848524.320048:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665a00/0x9aeb41e0543cc53b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc542 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.320074:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50665a00/0x9aeb41e0543cc53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc542 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848524.320082:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ff5ede2000 from 1 10000000:01000000:0.0:1787848524.320085:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787848524.320119:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.320127:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.320136:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848524.320458:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631423488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787848524.321360:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848524.321514:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787848524.321599:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+9:14361:x1874694631423360:12345-0@lo:502:llog_process_th.0 Request processed in 2981us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848524.321610:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787848524.321864:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631423488 00000100:00100000:1.0:1787848524.321873:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631423488 00000100:00100000:2.0:1787848524.321955:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787848524.321977:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+9:14325:x1874694631423488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787848524.322833:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848524.322857:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cc5c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc5b9 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.322885:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cc5c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc5b9 expref: 10 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.322896:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cc5c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc5b9 expref: 10 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.322918:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665c00, rc 0) 00000100:00100000:2.0:1787848524.323331:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+10:14325:x1874694631423488:12345-0@lo:101:mount.lustre.0 Request processed in 1354us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848524.323339:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787848524.323630:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631423488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787848524.323894:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.323906:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848524.324903:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791961c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631423616:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787848524.325210:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848524.325326:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff51d1da80 going to sleep for 11 seconds 00000100:00100000:0.0:1787848524.325937:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631423616 00000100:00100000:0.0:1787848524.325947:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631423616 00000100:00100000:1.0:1787848524.326533:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787848524.326544:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+10:14325:x1874694631423616:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787848524.326567:0:14337:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787848524.326573:0:14337:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787848524.326715:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+10:14325:x1874694631423616:12345-0@lo:256:mount.lustre.0 Request processed in 173us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848524.326723:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787848524.326841:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791961c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631423616:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787848524.327934:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787848524.327952:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.327963:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848524.327972:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff5ede2000 from 1 10000000:01000000:2.0:1787848524.327974:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787848524.328137:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.328154:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.328163:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848524.328182:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631423744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787848524.328227:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848524.329229:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52374540 going to sleep for 11 seconds 00000100:00100000:0.0:1787848524.330297:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631423744 00000100:00100000:0.0:1787848524.330309:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631423744 00000100:00100000:0.0:1787848524.330374:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787848524.330402:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+10:14325:x1874694631423744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787848524.330419:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848524.330561:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc5ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc5c7 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.330587:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc5ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc5c7 expref: 11 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.330599:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc5ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc5c7 expref: 11 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.330607:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40031200, rc 0) 00000100:00100000:0.0:1787848524.330927:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14325:x1874694631423744:12345-0@lo:101:mount.lustre.0 Request processed in 545us (2698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848524.330935:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787848524.331166:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631423744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787848524.331194:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.331203:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848524.331265:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631423872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848524.331311:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848524.331892:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52374540 going to sleep for 11 seconds 00000100:00100000:1.0:1787848524.331945:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631423872 00000100:00100000:1.0:1787848524.331951:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631423872 00000100:00100000:1.0:1787848524.332245:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787848524.332255:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14325:x1874694631423872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787848524.333314:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14325:x1874694631423872:12345-0@lo:501:mount.lustre.0 Request processed in 1058us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848524.333323:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787848524.334838:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631423872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848524.334894:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631424000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787848524.334955:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848524.336370:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52374540 going to sleep for 11 seconds 00000100:00100000:1.0:1787848524.336423:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631424000 00000100:00100000:1.0:1787848524.336490:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631424000 00000100:00100000:1.0:1787848524.336596:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787848524.336606:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14325:x1874694631424000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787848524.336945:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14325:x1874694631424000:12345-0@lo:503:mount.lustre.0 Request processed in 340us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848524.336953:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787848524.337425:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631424000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787848524.338001:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14369:1874694631424128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848524.338060:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848524.339260:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff456b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787848524.339605:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631424128 00000100:00100000:3.0:1787848524.339614:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631424128 00000100:00100000:3.0:1787848524.339721:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787848524.339730:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14369:x1874694631424128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787848524.340000:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14369:x1874694631424128:12345-0@lo:502:llog_process_th.0 Request processed in 271us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848524.340013:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787848524.340485:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14369:1874694631424128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787848524.340519:0:14369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848524.340530:0:14369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848524.340533:0:14369:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787848524.340539:0:14369:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ff5ede2000 00000020:00000080:0.0:1787848524.340541:0:14369:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787848524.340549:0:14369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848524.340551:0:14369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848524.340558:0:14369:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787848524.340563:0:14369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848524.340565:0:14369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848524.340566:0:14369:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787848524.340569:0:14369:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ff5ede2000 00000020:00000080:0.0:1787848524.340572:0:14369:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787848524.340623:0:14369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848524.343790:0:14369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848524.343798:0:14369:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787848524.343811:0:14369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848524.343816:0:14369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848524.343818:0:14369:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787848524.343823:0:14369:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ff5ede2000 00000020:00000080:0.0:1787848524.343826:0:14369:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787848524.351577:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79196580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14369:1874694631424256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787848524.352214:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848524.352264:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed60cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848524.353240:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631424256 00000100:00100000:2.0:1787848524.353252:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631424256 00000100:00100000:2.0:1787848524.353399:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787848524.353411:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14369:x1874694631424256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787848524.354904:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14369:x1874694631424256:12345-0@lo:502:llog_process_th.0 Request processed in 1491us (3206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848524.354916:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787848524.355264:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79196580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14369:1874694631424256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787848524.355799:0:14369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848524.355807:0:14369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848524.355810:0:14369:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787848524.355815:0:14369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787848524.360834:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787848524.360877:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787848524.360902:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848524.360916:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848524.360973:0:14325:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787848524.360976:0:14325:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ff5ede2000 10000000:01000000:3.0:1787848524.360985:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ff5ede2000 10000000:01000000:3.0:1787848524.360990:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787848524.360998:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ff5ede2000 from 1 10000000:01000000:3.0:1787848524.361001:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787848524.361537:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236200/0x9aeb41e0543cc5d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848524.361545:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff79236200/0x9aeb41e0543cc5d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848524.361556:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff79236200/0x9aeb41e0543cc5d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848524.361579:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631424384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787848524.361673:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848524.362100:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff44eec180 going to sleep for 11 seconds 00000100:00100000:3.0:1787848524.363874:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631424384 00000100:00100000:3.0:1787848524.363887:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631424384 00000100:00100000:3.0:1787848524.363945:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787848524.363956:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14325:x1874694631424384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787848524.363983:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848524.364071:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79236e00/0x9aeb41e0543cc5dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc5d5 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848524.364101:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79236e00/0x9aeb41e0543cc5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc5d5 expref: 12 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848524.364113:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79236e00/0x9aeb41e0543cc5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc5d5 expref: 12 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848524.364134:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236e00, rc 0) 00000100:00100000:3.0:1787848524.364404:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14325:x1874694631424384:12345-0@lo:101:mount.lustre.0 Request processed in 449us (2730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848524.364412:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787848524.364472:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631424384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787848524.364488:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff79236200/0x9aeb41e0543cc5d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5dc expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848524.364496:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff79236200/0x9aeb41e0543cc5d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc5dc expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848524.364558:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631424512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787848524.364591:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848524.364618:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff44eec180 going to sleep for 11 seconds 00000100:00100000:3.0:1787848524.364631:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631424512 00000100:00100000:3.0:1787848524.364634:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631424512 00000100:00100000:3.0:1787848524.364672:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787848524.365418:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14325:x1874694631424512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787848524.365683:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14325:x1874694631424512:12345-0@lo:501:mount.lustre.0 Request processed in 257us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848524.375862:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631424512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848524.375926:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631424640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787848524.376014:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848524.376055:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff52374d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787848524.376075:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631424640 00000100:00100000:2.0:1787848524.376087:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631424640 00000100:00100000:2.0:1787848524.376135:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787848524.376157:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+13:14325:x1874694631424640:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787848524.376565:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+13:14325:x1874694631424640:12345-0@lo:503:mount.lustre.0 Request processed in 409us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848524.376573:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787848524.376621:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631424640:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787848524.382200:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14374:1874694631424768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787848524.386565:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848524.386625:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787848524.386861:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787848524.387040:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631424768 00000100:00100000:3.0:1787848524.387048:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631424768 00000100:00100000:3.0:1787848524.387086:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787848524.387095:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14374:x1874694631424768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787848524.387610:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14374:x1874694631424768:12345-0@lo:502:llog_process_th.0 Request processed in 514us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848524.387617:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787848524.387744:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14374:1874694631424768:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787848524.387806:0:14374:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787848524.387823:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93ff8146b3a0) 00000020:00000080:3.0:1787848524.387844:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787848524.387919:0:14374:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ff5ede2000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787848524.387922:0:14374:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ff5ede2000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787848524.387925:0:14374:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ff5ede2000 4 00010000:00080000:3.0:1787848524.387967:0:14374:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ff64a7f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:3.0:1787848524.402313:0:14374:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787848524.402551:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787848524.402590:0:14374:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787848524.402604:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9aeb41e0543cc5ea 00000100:00080000:3.0:1787848524.402615:0:14374:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787848524.402622:0:14374:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93ff64a7f000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787848524.402694:0:14374:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff7fd5e940 x1874694631424896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787848524.402744:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874694631424896:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787848524.402816:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787848524.402871:0:14374:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787848524.403051:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14374:1874694631425024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787848524.403090:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848524.403103:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f691f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787848524.403121:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631425024 00000100:00100000:3.0:1787848524.403130:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631425024 00000100:00100000:3.0:1787848524.403167:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787848524.403176:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14374:x1874694631425024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787848524.403444:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14374:x1874694631425024:12345-0@lo:502:llog_process_th.0 Request processed in 268us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848524.403452:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787848524.403503:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14374:1874694631425024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787848524.403528:0:14374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:0.0:1787848524.408577:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631424896 00000100:00100000:0.0:1787848524.408593:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631424896 00000100:00100000:0.0:1787848524.408681:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848524.408692:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874694631424896:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787848524.408802:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874694631424896:12345-0@lo:38:llog_process_th.0 Request processed in 110us (5985us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787848524.408809:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:0.0:1787848524.408840:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787848524.408870:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787848524.408884:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236200/0x9aeb41e0543cc5d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5dc expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848524.408896:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff79236200/0x9aeb41e0543cc5d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5dc expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787848524.408956:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787848524.408958:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787848524.408960:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787848524.408961:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787848524.408962:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787848524.408964:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787848524.408965:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787848524.408967:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787848524.408969:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787848524.408970:0:14325:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787848524.408974:0:14325:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787848524.408976:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787848524.408978:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000100:00100000:1.0:1787848524.408980:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000020:01000004:0.0:1787848524.408980:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787848524.408983:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787848524.408985:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787848524.408988:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787848524.408989:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787848524.408990:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00080000:1.0:1787848524.408992:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff64a7f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000020:01000004:0.0:1787848524.408992:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787848524.408996:0:14325:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787848524.409029:0:14325:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787848524.409048:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79193480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631425152:0@lo:253:mount.lustre.0 00000100:00080000:1.0:1787848524.409059:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787848524.409066:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874694631424896:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787848524.409093:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848524.409143:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787848524.409284:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631425152 00000100:00100000:1.0:1787848524.409290:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631425152 00000100:00100000:1.0:1787848524.409335:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787848524.409342:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14325:x1874694631425152:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787848524.409392:0:14338:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787848524.409410:0:14338:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787848524.468397:0:14338:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787848524.468421:0:14338:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787848524.468567:0:14359:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787848524.468573:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787848524.468597:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.468621:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cc5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc5b9 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.468630:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.468719:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cc5c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cc5b9 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.468735:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cc5c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5b9 expref: 12 pid: 14337 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848524.468771:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79194b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1874694631425280:0@lo:104: 00000100:00100000:1.0:1787848524.468844:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848524.468898:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed60540 going to sleep for 11 seconds 00000100:00100000:2.0:1787848524.469096:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631425280 00000100:00100000:2.0:1787848524.469102:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631425280 00000100:00100000:2.0:1787848524.469148:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787848524.469155:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79197480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+3:14359:x1874694631425280:12345-0@lo:104: 00010000:00010000:2.0:1787848524.469166:0:14326:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469211:0:14326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787848524.469215:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79197480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+3:14359:x1874694631425280:12345-0@lo:104: Request processed in 62us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848524.469220:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787848524.469236:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848524.469240:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469254:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030e00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:2.0:1787848524.469256:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469276:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787848524.469281:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848524.469285:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787848524.469309:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469316:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787848524.469333:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469339:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff40030e00/0x9aeb41e0543cc5b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc5c0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469357:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848524.469359:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848524.469360:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848524.469402:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631425408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787848524.469432:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848524.469487:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631425408 00000100:00100000:2.0:1787848524.469491:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631425408 00010000:00010000:2.0:1787848524.469506:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cc5c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5b9 expref: 13 pid: 14337 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848524.469526:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787848524.469533:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79249a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+13:3312:x1874694631425408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787848524.469558:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848524.469565:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cc5c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5b9 expref: 13 pid: 14337 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469575:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cc5c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5b9 expref: 13 pid: 14337 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469589:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469597:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787848524.469607:0:14328:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001035943s 00010000:00010000:2.0:1787848524.469611:0:14328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469615:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469620:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469624:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469627:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848524.469630:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469634:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469677:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848524.469684:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787848524.469714:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79249a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+13:3312:x1874694631425408:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848524.469719:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787848524.469753:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631425408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787848524.470182:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff50665c00/0x9aeb41e0543cc5c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cc5b9 expref: 12 pid: 14337 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848524.470190:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79194b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1874694631425280:0@lo:104: 00010000:00010000:1.0:1787848524.470200:0:14359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.470206:0:14359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.470210:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848524.470214:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff5f42e600/0x9aeb41e0543cc5f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848524.485983:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14325:x1874694631425152:12345-0@lo:253:mount.lustre.0 Request processed in 76632us (76881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848524.486000:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787848524.486033:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79193480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14325:1874694631425152:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787848524.486049:0:14325:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787848524.486052:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787848524.486054:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787848524.486056:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787848524.486057:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787848524.486059:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787848524.486060:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787848524.486062:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787848524.486063:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787848524.486078:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787848524.486079:0:14325:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787848524.486094:0:14325:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787848524.491674:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848524.491932:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787848524.492402:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848524.492526:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787848524.492869:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787848524.493098:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787848524.494250:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787848524.494479:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787848524.494826:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787848524.495360:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787848524.495624:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787848524.495980:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787848524.526536:0:14325:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787848524.529391:0:14325:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787848524.529837:0:14383:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787848524.529967:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787848524.532069:0:14325:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787848524.532189:0:14325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787848524.532611:0:14325:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787848524.532619:0:14325:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787848524.532774:0:14325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787848524.537352:0:14382:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787848524.537363:0:14382:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1787848524.537760:0:14383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787848524.537835:0:14383:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787848524.537839:0:14383:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1787848524.538941:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787848524.540333:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787848524.540393:0:14325:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787848524.552679:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787848524.561843:0:14325:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787848524.606100:0:14325:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787848524.606139:0:14325:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9c040d17988 00100000:10000000:1.0:1787848524.606149:0:14325:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787848524.606954:0:14325:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787848524.606973:0:14325:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787848524.606986:0:14325:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787848524.607003:0:14325:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787848524.976007:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787848525.429098:0:14340:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787848525.429106:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ff5ede2000 from 6 10000000:01000000:0.0:1787848525.429111:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787848525.429153:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848525.429165:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848525.429177:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848525.429201:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79190000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631425536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787848525.429265:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848525.429319:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff44f92d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848525.429378:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631425536 00000100:00100000:1.0:1787848525.429385:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631425536 00000100:00100000:1.0:1787848525.429436:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787848525.429445:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14340:x1874694631425536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848525.429459:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848525.429472:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff5f42e800/0x9aeb41e0543cc5ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc5f8 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848525.429495:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff5f42e800/0x9aeb41e0543cc5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc5f8 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848525.429506:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff5f42e800/0x9aeb41e0543cc5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc5f8 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848525.429514:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e800, rc 0) 00000100:00100000:1.0:1787848525.429555:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14340:x1874694631425536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848525.429562:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787848525.429606:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79190000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631425536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848525.429621:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848525.430054:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848525.430106:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79194000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631425664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787848525.430137:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848525.430160:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed60e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787848525.430174:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631425664 00000100:00100000:1.0:1787848525.430177:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631425664 00000100:00100000:1.0:1787848525.430197:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787848525.430204:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14340:x1874694631425664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787848525.430217:0:14338:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787848525.430231:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787848525.430234:0:14338:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787848525.430299:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14340:x1874694631425664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848525.430306:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787848525.430338:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79194000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631425664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787848525.430388:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787848525.430394:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848525.430403:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787848525.430953:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787848526.013585:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787848526.450459:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787848527.027208:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848528.050289:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848529.080915:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787848529.772220:0:14625:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787848529.782616:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787848529.782624:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787848529.782628:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787848529.782632:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787848529.782666:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787848529.782670:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787848529.782674:0:8:0:(import.c:65:import_set_state_nolock()) ffff93ff64a7f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787848529.782687:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93ff64a7f000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787848529.782711:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff7fd5c3c0 x1874694631425920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787848529.782755:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631425792:0@lo:400:kworker.0 00000100:00100000:3.0:1787848529.782840:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848529.782911:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874694631425920:0@lo:38:kworker.0 00000100:00100000:3.0:1787848529.782937:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848529.782990:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631425792 00000100:00100000:3.0:1787848529.782997:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631425792 00000100:00100000:3.0:1787848529.783037:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787848529.783046:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:3313:x1874694631425792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848529.783089:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:3313:x1874694631425792:12345-0@lo:400:kworker.0 Request processed in 45us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848529.783096:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787848529.783140:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631425792:0@lo:400:kworker.0 00000100:00100000:0.0:1787848529.783558:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631425920 00000100:00100000:0.0:1787848529.783564:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631425920 00000100:00100000:0.0:1787848529.783586:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787848529.783592:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874694631425920:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787848529.783613:0:14345:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1787848529.783665:0:14345:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9aeb41e0543cc606 00000004:00100000:0.0:1787848529.783680:0:14345:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787848529.783820:0:14345:0:(import.c:65:import_set_state_nolock()) ffff93ff5f207800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787848529.783859:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874694631425920:12345-0@lo:38:kworker.0 Request processed in 266us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848529.783866:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787848529.786303:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ff7fd5c3c0 x1874694631425920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787848539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787848529.786326:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787848529.786335:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787848529.786341:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787848529.786344:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff64a7f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787848529.786362:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874694631425920:0@lo:38:kworker.0 00010000:00010000:3.0:1787848530.096914:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848531.121780:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848532.148895:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848533.175443:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787848533.351758:0:14776:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec38d9320 20000000:00000080:2.0:1787848533.351789:0:14776:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ff815cac00 uarg=0000000000000000 20000000:01000000:2.0:1787848533.351831:0:14776:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787848533.351840:0:14776:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787848533.351846:0:14776:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787848533.358301:0:14777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787848533.361432:0:14776:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787848533.382247:0:14776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787848533.382311:0:14776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848533.382347:0:14776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc5ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc5c7 expref: 11 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848533.382356:0:14776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848533.382398:0:14776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc5ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cc5c7 expref: 11 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848533.382413:0:14776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc5ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5c7 expref: 11 pid: 14336 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848533.382428:0:14776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14776:1874694631426048:0@lo:104: 00000100:00100000:2.0:1787848533.382495:0:14776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848533.382576:0:14776:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff48435780 going to sleep for 11 seconds 00000100:00100000:3.0:1787848533.383099:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631426048 00000100:00100000:3.0:1787848533.383108:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631426048 00000100:00100000:3.0:1787848533.383164:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787848533.383175:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+3:14776:x1874694631426048:12345-0@lo:104: 00010000:00010000:3.0:1787848533.383189:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848533.383274:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787848533.383280:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+3:14776:x1874694631426048:12345-0@lo:104: Request processed in 107us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848533.383287:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787848533.383351:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848533.383358:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383366:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665400 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:0.0:1787848533.383369:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383377:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848533.383384:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848533.383389:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787848533.383424:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383430:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787848533.383451:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383458:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc5c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc5ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383472:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848533.383482:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848533.383484:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848533.383507:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631426176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848533.383541:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848533.383603:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631426176 00000100:00100000:0.0:1787848533.383607:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631426176 00010000:00010000:0.0:1787848533.383626:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc5ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5c7 expref: 12 pid: 14336 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848533.383677:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787848533.383684:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:3310:x1874694631426176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787848533.383695:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848533.383700:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc5ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5c7 expref: 12 pid: 14336 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383709:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc5ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5c7 expref: 12 pid: 14336 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383726:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383735:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383750:0:14328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383757:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383764:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383778:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383783:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848533.383787:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383794:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383803:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848533.383813:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848533.383843:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:3310:x1874694631426176:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848533.383850:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787848533.383887:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631426176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787848533.384784:0:14776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc5ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cc5c7 expref: 11 pid: 14336 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848533.384799:0:14776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14776:1874694631426048:0@lo:104: 00010000:00010000:2.0:1787848533.384816:0:14776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848533.384825:0:14776:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848533.384832:0:14776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848533.384838:0:14776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc60d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848534.192165:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787848534.900156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787848534.900179:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787848534.900182:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787848534.900186:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787848534.900244:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787848534.900276:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79196940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631426304:0@lo:400:kworker.0 00000100:00100000:1.0:1787848534.900398:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848534.900474:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79195a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631426432:0@lo:400:kworker.0 00000100:00100000:1.0:1787848534.900508:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848534.900552:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631426304 00000100:00100000:1.0:1787848534.900562:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631426304 00000100:00100000:1.0:1787848534.900623:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787848534.900635:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:3310:x1874694631426304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848534.900738:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:3310:x1874694631426304:12345-0@lo:400:kworker.0 Request processed in 105us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848534.900747:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787848534.900811:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79196940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631426304:0@lo:400:kworker.0 00000100:00100000:0.0:1787848534.901980:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631426432 00000100:00100000:0.0:1787848534.901996:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631426432 00000100:00100000:0.0:1787848534.902077:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848534.902087:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79194f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631426432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848534.902182:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79194f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631426432:12345-0@lo:400:kworker.0 Request processed in 96us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848534.902190:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787848534.905223:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ff79195a40 x1874694631426432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848534.905251:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79195a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631426432:0@lo:400:kworker.0 00000100:00100000:0.0:1787848534.906182:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787848524/real 1787848524] req@ffff93ff7fd5da40 x1874694631423232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787848534 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848534.906242:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ff7fd5da40 x1874694631423232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787848534 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848534.906253:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787848524/real 1787848524] req@ffff93ff7fd5c000 x1874694631423104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787848534 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848534.906266:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ff7fd5c000 x1874694631423104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787848534 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787848534.906282:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787848534.906312:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787848534.906317:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631423232:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787848534.906323:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff79217800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787848534.906336:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787848534.906340:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631423104:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787848534.906456:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787848534.906461:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787848534.906465:0:36:0:(import.c:65:import_set_state_nolock()) ffff93ff79217800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787848534.906472:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1787848534.906477:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787848534.906486:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ff79217800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787848534.906529:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff7924a580 x1874694631426560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787848534.906555:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787848534.906559:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787848534.906561:0:36:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787848534.906564:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1787848534.906567:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787848534.906570:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ff80247800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787848534.906581:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff792492c0 x1874694631426688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787848534.906632:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631426560:0@lo:8:kworker.0 00000400:00000100:0.0:1787848534.906888:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874694631426560 offset 0 length 520: 4 00000100:00100000:0.0:1787848534.906938:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631426688:0@lo:8:kworker.0 00000400:00000100:0.0:1787848534.906963:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874694631426688 offset 0 length 520: 4 10000000:01000000:1.0:1787848534.963497:0:14340:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787848534.963508:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff5ede2000 from 10 10000000:01000000:1.0:1787848534.963517:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787848534.963581:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848534.963607:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848534.963622:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848534.963685:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79195a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631426816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787848534.963790:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848534.963846:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787848534.963953:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631426816 00000100:00100000:3.0:1787848534.963971:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631426816 00000100:00100000:3.0:1787848534.964067:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787848534.964081:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+11:14340:x1874694631426816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848534.964105:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848534.964132:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79236c00/0x9aeb41e0543cc61b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc614 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848534.964171:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79236c00/0x9aeb41e0543cc61b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc614 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848534.964184:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79236c00/0x9aeb41e0543cc61b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc614 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848534.964228:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236c00, rc 0) 00000100:00100000:3.0:1787848534.964343:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14340:x1874694631426816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 265us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848534.964350:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787848534.964992:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79195a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631426816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787848534.965031:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848534.965043:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848534.965152:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631426944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848534.965212:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848534.965260:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848534.965336:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631426944 00000100:00100000:1.0:1787848534.965352:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631426944 00000100:00100000:1.0:1787848534.965441:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787848534.965452:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14340:x1874694631426944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848534.965890:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14340:x1874694631426944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 439us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848534.965899:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787848534.966711:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631426944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848534.966812:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631427072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787848534.966885:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848534.966940:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848534.966962:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631427072 00000100:00100000:1.0:1787848534.966972:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631427072 00000100:00100000:1.0:1787848534.967015:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787848534.967025:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14340:x1874694631427072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848534.967239:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:14340:x1874694631427072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848534.967246:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787848534.967318:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631427072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787848534.971221:0:14826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787848534.977412:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787848534.977452:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787848534.977463:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848534.977475:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848535.217713:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848536.241963:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787848536.693946:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787848537.263902:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848538.289079:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848539.326828:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787848540.028968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787848540.028975:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787848540.028978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787848540.028981:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787848540.029012:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787848540.029034:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631427200:0@lo:400:kworker.0 00000100:00100000:0.0:1787848540.029123:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848540.029187:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631427328:0@lo:400:kworker.0 00000100:00100000:0.0:1787848540.029219:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848540.029253:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631427200 00000100:00100000:0.0:1787848540.029260:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631427200 00000100:00100000:0.0:1787848540.029308:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787848540.029316:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:3312:x1874694631427200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848540.029365:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:3312:x1874694631427200:12345-0@lo:400:kworker.0 Request processed in 48us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848540.029372:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787848540.029411:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631427328 00000100:00100000:0.0:1787848540.029414:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631427328 00000100:00100000:0.0:1787848540.029454:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787848540.029460:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631427328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848540.029497:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79193c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631427328:12345-0@lo:400:kworker.0 Request processed in 36us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848540.029503:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787848540.029545:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ff791930c0 x1874694631427328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848540.030126:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631427328:0@lo:400:kworker.0 00000100:00100000:0.0:1787848540.030164:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631427200:0@lo:400:kworker.0 00010000:00010000:0.0:1787848540.346189:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787848540.507007:0:15025:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787848540.507012:0:15025:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787848540.510633:0:15025:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93ff520f8800 00000020:01000004:2.0:1787848540.510850:0:15025:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787848540.510863:0:15025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787848540.510897:0:15025:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93ff67c20000) 00000020:00000080:2.0:1787848540.510916:0:15025:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787848540.572539:0:15025:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787848540.573677:0:15025:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787848540.575228:0:15025:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787848540.575544:0:15025:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787848540.575990:0:15025:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787848540.579664:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 241: rc = 0 00100000:10000000:2.0:1787848540.579770:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 241: rc = 0 00100000:10000000:2.0:1787848540.579923:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 241: rc = 0 00100000:10000000:2.0:1787848540.580470:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1787848540.580758:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1787848540.581009:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1787848540.586926:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1787848540.589309:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1787848540.592517:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:2.0:1787848540.593344:0:15025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787848540.593355:0:15025:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787848540.593363:0:15025:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aeb41e0543cc629 00000020:01000004:2.0:1787848540.593371:0:15025:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787848540.594500:0:15025:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787848540.594507:0:15025:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787848540.594516:0:15025:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787848540.594525:0:15025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787848540.594539:0:15025:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93ff67c24d70) 00000020:00000080:2.0:1787848540.594552:0:15025:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787848540.598274:0:15025:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787848540.598448:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787848540.598454:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787848540.606138:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787848540.608418:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787848540.609240:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787848540.609248:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787848540.611387:0:15025:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787848540.613175:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787848540.613193:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787848540.617858:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787848540.617948:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787848540.635626:0:15025:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787848540.636167:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787848540.636175:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787848540.640541:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787848540.640558:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787848540.643484:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787848540.643498:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787848540.646287:0:15025:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787848540.646480:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787848540.646486:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787848540.647580:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787848540.647588:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787848540.735828:0:15025:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787848540.736994:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787848540.737018:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787848540.739291:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787848540.739304:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787848540.739976:0:15025:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787848540.740002:0:15025:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787848540.740009:0:15025:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787848540.760688:0:15025:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787848540.760729:0:15025:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.126@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787848540.760734:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787848540.760736:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787848540.760737:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848540.760739:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848540.760740:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848540.760742:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848540.760743:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848540.760745:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848540.760747:0:15025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787848540.760750:0:15025:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787848540.760752:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787848540.760753:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787848540.760755:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848540.760756:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848540.760757:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848540.760758:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848540.760759:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848540.760760:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848540.760761:0:15025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787848540.760801:0:15025:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787848540.760826:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631427456:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787848540.760901:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848540.768363:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848540.774897:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631427456 00000100:00100000:1.0:1787848540.774912:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631427456 00000100:00100000:1.0:1787848540.774979:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787848540.774989:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:15025:x1874694631427456:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787848540.775338:0:14336:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787848540.775343:0:14336:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787848540.775346:0:14336:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787848540.800722:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:15025:x1874694631427456:12345-0@lo:253:mount.lustre.0 Request processed in 25725us (39811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848540.800740:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787848540.800904:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631427456:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787848540.800920:0:15025:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787848540.800924:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787848540.800926:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787848540.800940:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848540.800942:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848540.800943:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848540.800945:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848540.800946:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848540.800950:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848540.800951:0:15025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787848540.800976:0:15025:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93ff520f8800 from lustre-OST0000 10000000:01000000:2.0:1787848540.801000:0:15025:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787848540.801003:0:15025:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787848540.801009:0:15025:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93ff7fcc99d0 local copy 00010000:00010000:2.0:1787848540.801020:0:15025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc526 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848540.801264:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631427584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848540.801299:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848540.801326:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787848540.801414:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631427584 00000100:00100000:0.0:1787848540.801421:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631427584 00000100:00100000:0.0:1787848540.801467:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787848540.801476:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:15025:x1874694631427584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787848540.801626:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:15025:x1874694631427584:12345-0@lo:501:mount.lustre.0 Request processed in 150us (325us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787848540.801634:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787848540.801865:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631427584:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787848540.801877:0:15025:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787848540.801997:0:15025:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787848540.802005:0:15025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc526 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848540.802014:0:15025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc526 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848540.802032:0:15025:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ff520f8800 10000000:01000000:2.0:1787848540.802037:0:15025:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787848540.802041:0:15025:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93ff7fcc99d0 10000000:01000000:2.0:1787848540.802043:0:15025:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787848540.802046:0:15025:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93ff7fcc99d0 from 1 10000000:01000000:2.0:1787848540.802054:0:15025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787848540.802078:0:15025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc637 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848540.802086:0:15025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc637 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848540.802105:0:15025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc637 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848540.802120:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631427712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787848540.802145:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848540.802171:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787848540.802227:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631427712 00000100:00100000:1.0:1787848540.802232:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631427712 00000100:00100000:1.0:1787848540.802263:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787848540.802271:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+12:15025:x1874694631427712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787848540.802280:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848540.802295:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff5f42ea00/0x9aeb41e0543cc63e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc637 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848540.802315:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff5f42ea00/0x9aeb41e0543cc63e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc637 expref: 13 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848540.802333:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff5f42ea00/0x9aeb41e0543cc63e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc637 expref: 13 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848540.802342:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42ea00, rc 0) 00000100:00100000:1.0:1787848540.802390:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+13:15025:x1874694631427712:12345-0@lo:101:mount.lustre.0 Request processed in 120us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848540.802396:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787848540.802950:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631427712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787848540.802966:0:15025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc637 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc63e expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848540.802975:0:15025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc637 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc63e expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848540.802991:0:15025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787848540.803011:0:15025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc637 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc63e expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848540.803019:0:15025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50665400/0x9aeb41e0543cc637 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc63e expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848540.803033:0:15025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787848540.803037:0:15025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787848540.803048:0:15025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787848540.803050:0:15025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787848540.803067:0:15025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665e00/0x9aeb41e0543cc645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848540.803074:0:15025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50665e00/0x9aeb41e0543cc645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848540.803081:0:15025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50665e00/0x9aeb41e0543cc645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848540.803094:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631427840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787848540.803135:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848540.803158:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff802f8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787848540.803541:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631427840 00000100:00100000:3.0:1787848540.803548:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631427840 00000100:00100000:3.0:1787848540.803591:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787848540.803600:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+13:15025:x1874694631427840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787848540.803610:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848540.803622:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79237000/0x9aeb41e0543cc64c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc645 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848540.803682:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79237000/0x9aeb41e0543cc64c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc645 expref: 14 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848540.803693:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79237000/0x9aeb41e0543cc64c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc645 expref: 14 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848540.803701:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237000, rc 0) 00000100:00100000:2.0:1787848540.804158:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+14:15025:x1874694631427840:12345-0@lo:101:mount.lustre.0 Request processed in 558us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848540.804165:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787848540.804252:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631427840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787848540.804266:0:15025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50665e00/0x9aeb41e0543cc645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc64c expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848540.804275:0:15025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50665e00/0x9aeb41e0543cc645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc64c expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787848540.805321:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787848540.808253:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787848540.808520:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787848540.808567:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787848540.808604:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787848540.808706:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787848540.808761:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787848540.808798:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787848540.808874:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787848540.808883:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787848540.808966:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631427968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787848540.809032:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848540.809073:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848540.813169:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631427968 00000100:00100000:2.0:1787848540.813183:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631427968 00000100:00100000:2.0:1787848540.813261:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787848540.813273:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+14:15025:x1874694631427968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848540.813766:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+14:15025:x1874694631427968:12345-0@lo:501:mount.lustre.0 Request processed in 495us (4733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848540.813774:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787848540.815946:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631427968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787848540.816005:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787848540.816543:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848540.816593:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848540.816799:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631428096 00000100:00100000:2.0:1787848540.816806:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631428096 00000100:00100000:2.0:1787848540.816922:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787848540.816933:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+14:15025:x1874694631428096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787848540.817348:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+14:15025:x1874694631428096:12345-0@lo:503:mount.lustre.0 Request processed in 416us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848540.817366:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787848540.817677:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428096:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787848540.818381:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787848540.818759:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787848540.818807:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848540.819693:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787848540.824375:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631428224 00000100:00100000:3.0:1787848540.824397:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631428224 00000100:00100000:3.0:1787848540.824587:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787848540.824596:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+14:15025:x1874694631428224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787848540.824967:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+14:15025:x1874694631428224:12345-0@lo:502:mount.lustre.0 Request processed in 371us (6159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848540.824981:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787848540.826698:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787848540.827010:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787848540.827601:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787848540.827664:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787848540.827716:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787848540.827749:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787848540.827776:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787848540.827819:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787848540.827851:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787848540.827878:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787848540.827917:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787848540.827968:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787848540.828019:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787848540.829244:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787848540.829338:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848540.829402:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848540.831122:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631428352 00000100:00100000:2.0:1787848540.831134:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631428352 00000100:00100000:2.0:1787848540.831193:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787848540.831201:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+14:15025:x1874694631428352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787848540.831811:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+14:15025:x1874694631428352:12345-0@lo:502:mount.lustre.0 Request processed in 608us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848540.831820:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787848540.833191:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787848540.833324:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787848540.833347:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787848540.835848:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787848540.835859:0:15039:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787848540.835865:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848540.835868:0:15039:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787848540.835874:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787848540.835890:0:15039:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93ff67c233a0) 00000020:00000080:2.0:1787848540.835913:0:15039:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787848540.835920:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787848540.836001:0:15039:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ff520f8800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787848540.836010:0:15039:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787848540.836018:0:15039:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aeb41e0543cc65a 00010000:00010000:2.0:1787848540.851804:0:15039:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787848540.852318:0:15039:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787848540.858235:0:15039:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787848540.872055:0:15039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787848540.872068:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848540.872075:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848540.872078:0:15039:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787848540.872081:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787848540.872084:0:15039:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787848540.872085:0:15039:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787848540.872087:0:15039:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787848540.872089:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787848540.872091:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848540.872093:0:15039:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787848540.872106:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787848540.872110:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848540.872111:0:15039:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787848540.872114:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787848540.872116:0:15039:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787848540.872118:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848540.872120:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848540.872121:0:15039:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787848540.872124:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787848540.872126:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848540.872128:0:15039:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787848540.872132:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787848540.872195:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848540.872199:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848540.872201:0:15039:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787848540.872204:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787848540.872581:0:15025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787848540.872607:0:15025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787848540.872705:0:15025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50665e00/0x9aeb41e0543cc645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc64c expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848540.872718:0:15025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50665e00/0x9aeb41e0543cc645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc64c expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848540.872727:0:15025:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff520f8800 from 1 10000000:01000000:0.0:1787848540.872731:0:15025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787848540.872768:0:15025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848540.872776:0:15025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848540.872787:0:15025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848540.872813:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787848540.872881:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848540.872918:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787848540.873007:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631428480 00000100:00100000:3.0:1787848540.873015:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631428480 00000100:00100000:3.0:1787848540.873067:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787848540.873076:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff42b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+14:15025:x1874694631428480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787848540.873111:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848540.873127:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79236600/0x9aeb41e0543cc668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc661 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848540.873150:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79236600/0x9aeb41e0543cc668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc661 expref: 15 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848540.873161:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79236600/0x9aeb41e0543cc668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc661 expref: 15 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848540.873170:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236600, rc 0) 00000100:00100000:3.0:1787848540.873207:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff42b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:15025:x1874694631428480:12345-0@lo:101:mount.lustre.0 Request processed in 132us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848540.873214:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787848540.875589:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787848540.875617:0:15025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848540.875629:0:15025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787848540.876251:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787848540.878429:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787848540.878756:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787848540.878801:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787848540.878863:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787848540.878872:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787848540.878952:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787848540.879011:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848540.879063:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848540.879578:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631428608 00000100:00100000:1.0:1787848540.879586:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631428608 00000100:00100000:1.0:1787848540.879657:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787848540.879668:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff42b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:15025:x1874694631428608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787848540.879909:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff42b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:15025:x1874694631428608:12345-0@lo:501:mount.lustre.0 Request processed in 243us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848540.879918:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787848540.880808:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787848540.880858:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787848540.880919:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848540.880958:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848540.881224:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631428736 00000100:00100000:1.0:1787848540.881230:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631428736 00000100:00100000:1.0:1787848540.881262:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787848540.881271:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff42b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:15025:x1874694631428736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787848540.881823:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff42b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:15025:x1874694631428736:12345-0@lo:503:mount.lustre.0 Request processed in 552us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848540.881831:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787848540.881996:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787848540.882555:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787848540.882619:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787848540.882697:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848540.882724:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff606cd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848540.883257:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631428864 00000100:00100000:0.0:1787848540.883263:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631428864 00000100:00100000:0.0:1787848540.883303:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787848540.883311:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff42b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:15025:x1874694631428864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787848540.883702:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff42b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:15025:x1874694631428864:12345-0@lo:502:mount.lustre.0 Request processed in 391us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848540.883709:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787848540.883942:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787848540.884239:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787848540.884290:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787848540.884341:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787848540.892023:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787848540.892139:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787848540.892245:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787848540.892290:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787848540.892324:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787848540.899699:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791930c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787848540.899809:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848540.899858:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fba3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787848540.899939:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631428992 00000100:00100000:3.0:1787848540.899947:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631428992 00000100:00100000:3.0:1787848540.899998:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787848540.900009:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:15025:x1874694631428992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787848540.900252:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:15025:x1874694631428992:12345-0@lo:502:mount.lustre.0 Request processed in 243us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848540.900260:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787848540.900748:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791930c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631428992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787848540.900905:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787848540.900920:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787848540.915143:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787848540.915156:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848540.915158:0:15043:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787848540.915166:0:15043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ff520f8800 00000020:00000080:2.0:1787848540.915168:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787848540.915175:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787848540.915178:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848540.915179:0:15043:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787848540.915182:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787848540.915184:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848540.915185:0:15043:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787848540.915188:0:15043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ff520f8800 00000020:00000080:2.0:1787848540.915190:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787848540.930208:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848540.930358:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848540.930362:0:15043:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787848540.930367:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787848540.930372:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848540.930373:0:15043:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787848540.930392:0:15043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ff520f8800 00000020:00000080:3.0:1787848540.930395:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787848540.930508:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787848540.930523:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787848540.930525:0:15043:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787848540.930528:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787848540.933700:0:15025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787848540.933742:0:15025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787848540.933764:0:15025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848540.933777:0:15025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848540.933829:0:15025:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787848540.933833:0:15025:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ff520f8800 10000000:01000000:2.0:1787848540.933836:0:15025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ff520f8800 10000000:01000000:2.0:1787848540.933858:0:15025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787848540.933865:0:15025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ff520f8800 from 1 10000000:01000000:2.0:1787848540.933868:0:15025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787848540.933904:0:15025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cc66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848540.933913:0:15025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cc66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848540.933924:0:15025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cc66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848540.933950:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787848540.934019:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848540.934073:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff606cd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848540.946818:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631429120 00000100:00100000:0.0:1787848540.946835:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631429120 00000100:00100000:0.0:1787848540.946902:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787848540.946913:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:15025:x1874694631429120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787848540.946930:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848540.946949:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc66f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848540.946978:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc66f expref: 16 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848540.946989:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff40031200/0x9aeb41e0543cc676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc66f expref: 16 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848540.946999:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff40031200, rc 0) 00000100:00100000:0.0:1787848540.947091:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15025:x1874694631429120:12345-0@lo:101:mount.lustre.0 Request processed in 180us (13071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848540.947110:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787848540.954938:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787848540.954970:0:15025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cc66f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc676 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848540.954983:0:15025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cc66f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc676 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787848540.961291:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787848540.961905:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787848540.962176:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787848540.962215:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787848540.962243:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787848540.962301:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787848540.962339:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787848540.966611:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787848540.966749:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787848540.966791:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787848540.966864:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787848540.966896:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787848540.966930:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787848540.966993:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787848540.967033:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787848540.967082:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787848540.967152:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787848540.967188:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787848540.967217:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787848540.970627:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787848540.970729:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787848540.970756:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787848540.970797:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787848540.970825:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787848540.970849:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787848540.970884:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787848540.970933:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787848540.970959:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787848540.970996:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787848540.971033:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787848540.978931:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787848540.978957:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787848540.979083:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848540.979161:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848540.979218:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff48435240 going to sleep for 11 seconds 00000100:00100000:1.0:1787848540.979310:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631429248 00000100:00100000:1.0:1787848540.979317:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631429248 00000100:00100000:1.0:1787848540.979391:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787848540.979401:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15025:x1874694631429248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787848540.979698:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15025:x1874694631429248:12345-0@lo:501:mount.lustre.0 Request processed in 298us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848540.979713:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787848540.986071:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848540.986168:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429376:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787848540.986276:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848540.986328:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff48435240 going to sleep for 11 seconds 00000100:00100000:2.0:1787848540.986351:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631429376 00000100:00100000:2.0:1787848540.986358:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631429376 00000100:00100000:2.0:1787848540.986487:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787848540.986495:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15025:x1874694631429376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787848540.986715:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15025:x1874694631429376:12345-0@lo:503:mount.lustre.0 Request processed in 219us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848540.986723:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787848540.986782:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429376:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787848540.987337:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787848540.987400:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787848540.992799:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848540.992847:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff48435240 going to sleep for 11 seconds 00000100:00100000:0.0:1787848540.994867:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631429504 00000100:00100000:0.0:1787848540.994880:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631429504 00000100:00100000:0.0:1787848540.994947:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787848540.994958:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15025:x1874694631429504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787848540.995269:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15025:x1874694631429504:12345-0@lo:502:mount.lustre.0 Request processed in 313us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848540.995287:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787848540.996507:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787848540.996847:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787848540.996906:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787848540.996944:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787848540.996989:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787848541.011060:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787848541.011264:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787848541.011312:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787848541.011362:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787848541.011457:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787848541.011495:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787848541.011529:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787848541.011576:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787848541.011613:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787848541.011671:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787848541.011736:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787848541.011775:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787848541.011809:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787848541.011857:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787848541.011895:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787848541.011931:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787848541.011980:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787848541.012015:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787848541.012050:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787848541.012118:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787848541.012172:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787848541.012207:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787848541.012260:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787848541.012297:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787848541.012334:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787848541.012397:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787848541.012438:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787848541.012473:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787848541.012508:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787848541.012561:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787848541.012599:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787848541.012696:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787848541.012737:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787848541.012774:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787848541.012824:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787848541.012858:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787848541.014007:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787848541.014164:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848541.014268:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff48435240 going to sleep for 11 seconds 00000100:00100000:0.0:1787848541.016849:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631429632 00000100:00100000:0.0:1787848541.016864:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631429632 00000100:00100000:0.0:1787848541.016933:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787848541.016944:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15025:x1874694631429632:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787848541.021366:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15025:x1874694631429632:12345-0@lo:502:mount.lustre.0 Request processed in 4416us (7194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848541.021866:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787848541.023608:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787848541.023789:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787848541.023814:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787848541.026747:0:15048:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787848541.026765:0:15048:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93ff67c219d0) 00000020:00000080:2.0:1787848541.026790:0:15048:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787848541.026865:0:15048:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ff520f8800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787848541.026869:0:15048:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ff520f8800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787848541.026871:0:15048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ff520f8800 3 00010000:00080000:2.0:1787848541.026899:0:15048:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ff521fc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.126@tcp at head 00010000:00010000:1.0:1787848541.041004:0:15048:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787848541.043776:0:15048:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787848541.043818:0:15048:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787848541.043831:0:15048:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9aeb41e0543cc684 00000100:00080000:1.0:1787848541.043843:0:15048:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787848541.043850:0:15048:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93ff521fc800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:1.0:1787848541.043886:0:15048:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff791970c0 x1874694631429760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787848541.043938:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874694631429760:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787848541.044010:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787848541.044080:0:15048:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787848541.047737:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631429760 00000100:00100000:3.0:1787848541.047752:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631429760 00000100:00100000:3.0:1787848541.047796:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787848541.047804:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874694631429760:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787848541.047835:0:14345:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:3.0:1787848541.047870:0:14345:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9aeb41e0543cc68b 00000004:00100000:3.0:1787848541.047887:0:14345:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787848541.047927:0:14345:0:(import.c:65:import_set_state_nolock()) ffff93ff430a3000 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1787848541.048203:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787848541.048265:0:15025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787848541.048296:0:15025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787848541.048312:0:15025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cc66f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc676 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.048323:0:15025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50664e00/0x9aeb41e0543cc66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc676 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787848541.048369:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787848541.048372:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787848541.048373:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787848541.048375:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787848541.048376:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787848541.048377:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787848541.048379:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787848541.048395:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787848541.048397:0:15025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787848541.048407:0:15025:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787848541.048410:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787848541.048417:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787848541.048418:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787848541.048419:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787848541.048420:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787848541.048420:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787848541.048421:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787848541.048422:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787848541.048423:0:15025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787848541.048446:0:15025:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787848541.048465:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429888:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787848541.048516:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848541.048555:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff60100d80 going to sleep for 11 seconds 00000100:00080000:2.0:1787848541.054766:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787848541.054778:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787848541.054781:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787848541.054785:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787848541.055156:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631430016:0@lo:400:kworker.0 00000100:00100000:0.0:1787848541.055227:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848541.055583:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787848541.055594:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787848541.056155:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874694631429760:12345-0@lo:38:llog_process_th.0 Request processed in 8346us (12140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848541.056166:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787848541.056192:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631430016 00000100:00100000:3.0:1787848541.056198:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631430016 00000100:00100000:3.0:1787848541.056246:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787848541.056254:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79191a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631430016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848541.056324:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79191a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631430016:12345-0@lo:400:kworker.0 Request processed in 71us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848541.056332:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787848541.056356:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631429888 00000100:00100000:3.0:1787848541.056360:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631429888 00000100:00100000:3.0:1787848541.056399:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787848541.056599:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15025:x1874694631429888:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787848541.056622:0:14336:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787848541.056636:0:14336:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787848541.057018:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ff79249680 x1874694631430016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848541.057120:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631430016:0@lo:400:kworker.0 00010000:00080000:0.0:1787848541.060342:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ff791970c0 x1874694631429760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787848551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848541.060359:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787848541.060369:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787848541.060378:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787848541.060400:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787848541.060672:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff521fc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787848541.060681:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874694631429760:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1787848541.135900:0:14336:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787848541.135954:0:14336:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787848541.138243:0:14359:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787848541.138255:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787848541.138282:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.138304:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff5f42e800/0x9aeb41e0543cc5ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc5f8 expref: 16 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.138313:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.138367:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff5f42e800/0x9aeb41e0543cc5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cc5f8 expref: 16 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.138395:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff5f42e800/0x9aeb41e0543cc5ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5f8 expref: 16 pid: 14337 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848541.138417:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79195680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1874694631430144:0@lo:104: 00000100:00100000:1.0:1787848541.138481:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848541.138528:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff430dca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848541.138553:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631430144 00000100:00100000:1.0:1787848541.138574:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631430144 00000100:00100000:1.0:1787848541.138618:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787848541.138627:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+3:14359:x1874694631430144:12345-0@lo:104: 00010000:00010000:1.0:1787848541.138657:0:14326:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.138712:0:14326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787848541.138718:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+3:14359:x1874694631430144:12345-0@lo:104: Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848541.138726:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787848541.138753:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848541.138759:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.138768:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031c00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:1.0:1787848541.138772:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.138781:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787848541.138789:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787848541.138794:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787848541.138826:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.138833:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787848541.138852:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.138864:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff40031c00/0x9aeb41e0543cc5f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc5ff expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.138880:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848541.138882:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848541.138883:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848541.138898:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631430272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787848541.138924:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848541.138986:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631430272 00000100:00100000:1.0:1787848541.138990:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631430272 00010000:00010000:1.0:1787848541.139005:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff5f42e800/0x9aeb41e0543cc5ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5f8 expref: 17 pid: 14337 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848541.139026:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787848541.139032:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79196940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:3312:x1874694631430272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787848541.139042:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848541.139046:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff5f42e800/0x9aeb41e0543cc5ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5f8 expref: 17 pid: 14337 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139056:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff5f42e800/0x9aeb41e0543cc5ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cc5f8 expref: 17 pid: 14337 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139072:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139080:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787848541.139104:0:14328:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001035943s 00010000:00010000:1.0:1787848541.139113:0:14328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139121:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139127:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139134:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139139:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848541.139142:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139149:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139157:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139165:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848541.139190:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79196940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:3312:x1874694631430272:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848541.139197:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787848541.139228:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631430272:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787848541.139250:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff5f42e800/0x9aeb41e0543cc5ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cc5f8 expref: 16 pid: 14337 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848541.139259:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79195680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1874694631430144:0@lo:104: 00010000:00010000:1.0:1787848541.139277:0:14359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139286:0:14359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139293:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848541.139299:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff5f42e400/0x9aeb41e0543cc692 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848541.153661:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:15025:x1874694631429888:12345-0@lo:253:mount.lustre.0 Request processed in 97031us (105111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848541.153679:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787848541.154756:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15025:1874694631429888:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787848541.154773:0:15025:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787848541.154777:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787848541.154778:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787848541.154779:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787848541.154780:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787848541.154782:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787848541.154783:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787848541.154784:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787848541.154786:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787848541.154788:0:15025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787848541.154805:0:15025:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787848541.158971:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787848541.159157:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787848541.159315:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787848541.159615:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787848541.159841:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787848541.160034:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787848541.161541:0:15025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787848541.242846:0:15025:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787848541.242856:0:15025:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787848541.242887:0:15025:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787848541.242948:0:15025:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787848541.242963:0:15025:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787848541.243005:0:15025:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787848541.361385:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848542.385093:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787848542.709841:0:14340:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787848542.709848:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ff5ede2000 from 7 10000000:01000000:3.0:1787848542.709852:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787848542.709899:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848542.709912:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848542.709925:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848542.709952:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631430400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787848542.710022:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848542.710222:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fbe16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848542.711347:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631430400 00000100:00100000:2.0:1787848542.711357:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631430400 00000100:00100000:3.0:1787848542.711497:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787848542.711510:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+15:14340:x1874694631430400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848542.711525:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848542.711545:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc6a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc699 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848542.711570:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc699 expref: 16 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848542.711595:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc699 expref: 16 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848542.711620:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237200, rc 0) 00000100:00100000:3.0:1787848542.711714:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:14340:x1874694631430400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848542.711721:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787848542.711778:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631430400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848542.711795:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848542.711804:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848542.711862:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631430528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787848542.711898:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848542.711920:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631430528 00000100:00100000:3.0:1787848542.711923:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fbe16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787848542.711925:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631430528 00000100:00100000:2.0:1787848542.711948:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787848542.711955:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:14340:x1874694631430528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787848542.711970:0:14338:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787848542.711987:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787848542.711990:0:14338:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787848542.712090:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:14340:x1874694631430528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848542.712097:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787848542.712239:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631430528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787848542.712299:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787848542.712306:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848542.712314:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848543.408228:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848544.431865:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848545.456067:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787848546.165539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787848546.165547:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787848546.165550:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787848546.165553:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787848546.165599:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631430784:0@lo:400:kworker.0 00000100:00100000:0.0:1787848546.165695:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848546.165748:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787848546.165754:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631430912:0@lo:400:kworker.0 00000100:00100000:0.0:1787848546.165776:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848546.165879:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631430784 00000100:00100000:2.0:1787848546.165889:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631430784 00000100:00100000:2.0:1787848546.165943:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631430912 00000100:00100000:2.0:1787848546.165946:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631430912 00000100:00100000:2.0:1787848546.165975:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787848546.165985:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79190b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631430784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848546.166055:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79190b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631430784:12345-0@lo:400:kworker.0 Request processed in 72us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848546.166063:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787848546.166081:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787848546.166088:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79190f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631430912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848546.166114:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79190f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631430912:12345-0@lo:400:kworker.0 Request processed in 26us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848546.166120:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787848546.166159:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff791921c0 x1874694631430912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848546.167533:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631430912:0@lo:400:kworker.0 00010000:00080000:2.0:1787848546.167573:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff79192940 x1874694631430784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848546.167586:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631430784:0@lo:400:kworker.0 00000100:00100000:1.0:1787848546.169623:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79191e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631430656:0@lo:400:kworker.0 00000100:00100000:1.0:1787848546.169723:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787848546.169815:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848546.171559:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631430656 00000100:00100000:0.0:1787848546.171572:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631430656 00000100:00100000:0.0:1787848546.171635:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787848546.171665:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:3313:x1874694631430656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848546.171768:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:3313:x1874694631430656:12345-0@lo:400:kworker.0 Request processed in 107us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848546.171776:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787848546.171845:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79191e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631430656:0@lo:400:kworker.0 00010000:00010000:0.0:1787848546.481954:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787848546.934583:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787848547.503949:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848548.527854:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787848549.076853:0:15392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787848549.232594:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787848534/real 1787848534] req@ffff93ff7924a580 x1874694631426560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787848549 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848549.232627:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ff7924a580 x1874694631426560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787848549 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848549.232674:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787848534/real 1787848534] req@ffff93ff792492c0 x1874694631426688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787848549 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848549.232688:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ff792492c0 x1874694631426688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787848549 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787848549.232707:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff79217800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787848549.232723:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787848549.232727:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631426560:0@lo:8:kworker.0 00000100:00080000:0.0:1787848549.232734:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787848549.232740:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787848549.232743:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631426688:0@lo:8:kworker.0 00000100:00080000:2.0:1787848549.232869:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787848549.232874:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787848549.232877:0:8:0:(import.c:65:import_set_state_nolock()) ffff93ff79217800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787848549.232882:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:2.0:1787848549.232893:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787848549.232901:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ff79217800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787848549.232922:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff7924a940 x1874694631431168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787848549.232934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787848549.232937:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787848549.232939:0:8:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787848549.232942:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:2.0:1787848549.232945:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787848549.232958:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ff80247800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787848549.232971:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff792483c0 x1874694631431296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787848549.233017:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631431552:0@lo:400:kworker.0 00000100:00100000:2.0:1787848549.233076:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848549.233136:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631431552 00000100:00100000:2.0:1787848549.233143:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631431552 00000100:00100000:2.0:1787848549.233197:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787848549.233205:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631431552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848549.233254:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631431552:12345-0@lo:400:kworker.0 Request processed in 50us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848549.233260:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787848549.233295:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff79248780 x1874694631431552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848549.233308:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631431552:0@lo:400:kworker.0 00000100:00100000:0.0:1787848549.233364:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631431040:0@lo:400:kworker.0 00000100:00100000:0.0:1787848549.233396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848549.233427:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787848549.233434:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631431424:0@lo:400:kworker.0 00000100:00100000:0.0:1787848549.233458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848549.233499:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631431424 00000100:00100000:0.0:1787848549.233503:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631431424 00000100:00100000:0.0:1787848549.233531:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787848549.233538:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631431424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848549.233573:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79191e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631431424:12345-0@lo:400:kworker.0 Request processed in 35us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848549.233580:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787848549.233610:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff79248b40 x1874694631431424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848549.233627:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631431424:0@lo:400:kworker.0 00000100:00100000:0.0:1787848549.233670:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631431168:0@lo:8:kworker.0 00000100:00100000:0.0:1787848549.233698:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848549.233716:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff792483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631431296:0@lo:8:kworker.0 00000100:00100000:0.0:1787848549.233736:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848549.233777:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631431168 00000100:00100000:0.0:1787848549.233781:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631431168 00000100:00100000:0.0:1787848549.233798:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631431296 00000100:00100000:0.0:1787848549.233800:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631431296 00000100:00100000:0.0:1787848549.233809:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848549.233814:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79191680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874694631431168:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787848549.233838:0:15026:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:0.0:1787848549.233866:0:15026:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aeb41e0543cc6a7 00002000:00100000:0.0:1787848549.233879:0:15026:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93ff7a44f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113956 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787848549.233883:0:15026:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787848549.233886:0:15026:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787848549.234567:0:15026:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787848549.234591:0:15026:0:(import.c:65:import_set_state_nolock()) ffff93ff7a44c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787848549.234664:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79191680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874694631431168:12345-0@lo:8:kworker.0 Request processed in 848us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848549.234672:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848549.234692:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787848549.234697:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874694631431296:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787848549.234708:0:15026:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787848549.234748:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874694631431296:12345-0@lo:8:kworker.0 Request processed in 50us (1010us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787848549.234754:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787848549.234790:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff7924a940 x1874694631431168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787848569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848549.234799:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787848549.234806:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787848549.234814:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787848549.234819:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787848549.234822:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff79217800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787848549.234836:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787848549.234840:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631431168:0@lo:8:kworker.0 00000100:00080000:0.0:1787848549.234852:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787848549.234855:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787848549.234858:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff792483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631431296:0@lo:8:kworker.0 00000004:00080000:0.0:1787848549.234906:0:14366:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1787848549.234921:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79190000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14366:1874694631431808:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787848549.234946:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848549.234974:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f692900 going to sleep for 11 seconds 00000004:00080000:0.0:1787848549.234989:0:14365:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787848549.235190:0:14365:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 498146549436ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787848549.235263:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631431680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848549.235291:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848549.235323:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631431808 00000100:00100000:0.0:1787848549.235327:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631431808 00000100:00100000:0.0:1787848549.235365:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787848549.235372:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79190780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14366:x1874694631431808:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787848549.235665:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631431040 00000100:00100000:2.0:1787848549.235675:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631431040 00000100:00100000:2.0:1787848549.235708:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787848549.235716:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:3312:x1874694631431040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848549.235760:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:3312:x1874694631431040:12345-0@lo:400:kworker.0 Request processed in 45us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848549.235766:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787848549.236025:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631431040:0@lo:400:kworker.0 00000100:00080000:2.0:1787848549.244783:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787848549.244794:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787848549.249713:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631431680 00000100:00100000:1.0:1787848549.249728:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631431680 00000100:00100000:1.0:1787848549.249797:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787848549.249808:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79192d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874694631431680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848549.249845:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848549.249931:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79192d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874694631431680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (14638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848549.249938:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787848549.255943:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff79193480 x1874694631431680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848549.255984:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631431680:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1787848549.262156:0:15026:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787848549.262427:0:15026:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787848549.262433:0:15026:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1787848549.279663:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.279677:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015428e21/0x9aeb41e0543cc6ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.279695:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.279699:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.279707:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015428e21/0x9aeb41e0543cc6ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.279727:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015428e21/0x9aeb41e0543cc6ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.279737:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015428e21/0x9aeb41e0543cc6ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.279744:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015428e21/0x9aeb41e0543cc6ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.279923:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787848549.280386:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.280392:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001924f7d5/0x9aeb41e0543cc6b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.280412:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.280415:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.280419:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001924f7d5/0x9aeb41e0543cc6b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.280428:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001924f7d5/0x9aeb41e0543cc6b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.280436:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001924f7d5/0x9aeb41e0543cc6b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.280443:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001924f7d5/0x9aeb41e0543cc6b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.280467:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787848549.280856:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.280863:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fd39bc2/0x9aeb41e0543cc6bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.280872:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.280876:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.280880:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fd39bc2/0x9aeb41e0543cc6bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.280889:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fd39bc2/0x9aeb41e0543cc6bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.280908:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fd39bc2/0x9aeb41e0543cc6bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.280915:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fd39bc2/0x9aeb41e0543cc6bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.280923:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787848549.281314:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.281319:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082b28f09/0x9aeb41e0543cc6c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.281328:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.281331:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.281335:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082b28f09/0x9aeb41e0543cc6c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.281343:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082b28f09/0x9aeb41e0543cc6c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.281351:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082b28f09/0x9aeb41e0543cc6c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.281358:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082b28f09/0x9aeb41e0543cc6c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.281376:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787848549.281733:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.281739:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d3b6950/0x9aeb41e0543cc6ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.281747:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.281749:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.281753:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d3b6950/0x9aeb41e0543cc6ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.281762:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d3b6950/0x9aeb41e0543cc6ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.281769:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d3b6950/0x9aeb41e0543cc6ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.281776:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d3b6950/0x9aeb41e0543cc6ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.281783:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1787848549.282618:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787848549.282629:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015428e21/0x9aeb41e0543cc6ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282663:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.282668:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015428e21/0x9aeb41e0543cc6ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282678:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015428e21/0x9aeb41e0543cc6ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282705:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015428e21/0x9aeb41e0543cc6ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282714:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015428e21/0x9aeb41e0543cc6ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282743:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787848549.282756:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001924f7d5/0x9aeb41e0543cc6b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282763:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.282767:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001924f7d5/0x9aeb41e0543cc6b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282775:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001924f7d5/0x9aeb41e0543cc6b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282787:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001924f7d5/0x9aeb41e0543cc6b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282794:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001924f7d5/0x9aeb41e0543cc6b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282809:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787848549.282813:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fd39bc2/0x9aeb41e0543cc6bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282819:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.282821:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd39bc2/0x9aeb41e0543cc6bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282828:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd39bc2/0x9aeb41e0543cc6bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282848:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fd39bc2/0x9aeb41e0543cc6bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282855:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fd39bc2/0x9aeb41e0543cc6bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282866:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787848549.282870:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082b28f09/0x9aeb41e0543cc6c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282876:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030e00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.282879:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082b28f09/0x9aeb41e0543cc6c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282886:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082b28f09/0x9aeb41e0543cc6c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282895:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082b28f09/0x9aeb41e0543cc6c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282902:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082b28f09/0x9aeb41e0543cc6c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282913:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848549.282917:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d3b6950/0x9aeb41e0543cc6ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282929:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40031400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.282932:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d3b6950/0x9aeb41e0543cc6ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282939:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d3b6950/0x9aeb41e0543cc6ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282959:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d3b6950/0x9aeb41e0543cc6ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282967:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d3b6950/0x9aeb41e0543cc6ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.282981:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.282983:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.282985:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.285471:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.285487:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88469ef/0x9aeb41e0543cc6d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.285505:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.285526:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.285534:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d88469ef/0x9aeb41e0543cc6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.285549:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d88469ef/0x9aeb41e0543cc6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.285560:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88469ef/0x9aeb41e0543cc6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.285566:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d88469ef/0x9aeb41e0543cc6d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.285604:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787848549.288119:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.288132:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cabc5610/0x9aeb41e0543cc6d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.288149:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.288153:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.288162:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cabc5610/0x9aeb41e0543cc6d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.288175:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cabc5610/0x9aeb41e0543cc6d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.288186:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cabc5610/0x9aeb41e0543cc6d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.288203:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cabc5610/0x9aeb41e0543cc6d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.288214:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787848549.289516:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787848549.289527:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d88469ef/0x9aeb41e0543cc6d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.289537:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.289542:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88469ef/0x9aeb41e0543cc6d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.289552:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88469ef/0x9aeb41e0543cc6d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.289579:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d88469ef/0x9aeb41e0543cc6d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.289586:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d88469ef/0x9aeb41e0543cc6d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.289607:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848549.289611:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cabc5610/0x9aeb41e0543cc6d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.289618:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030800 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.289621:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cabc5610/0x9aeb41e0543cc6d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.289629:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cabc5610/0x9aeb41e0543cc6d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.289654:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cabc5610/0x9aeb41e0543cc6d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.289662:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cabc5610/0x9aeb41e0543cc6d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.289676:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.289678:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.289688:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.290980:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.290991:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de9cc26f/0x9aeb41e0543cc6df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.291005:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.291010:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.291015:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de9cc26f/0x9aeb41e0543cc6df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.291028:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de9cc26f/0x9aeb41e0543cc6df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.291039:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de9cc26f/0x9aeb41e0543cc6df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.291047:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de9cc26f/0x9aeb41e0543cc6df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.291069:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787848549.291930:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.291938:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ca8c0c/0x9aeb41e0543cc6e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.291969:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.291973:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.291978:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093ca8c0c/0x9aeb41e0543cc6e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.291988:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093ca8c0c/0x9aeb41e0543cc6e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.291997:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ca8c0c/0x9aeb41e0543cc6e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.292005:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093ca8c0c/0x9aeb41e0543cc6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.292013:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787848549.293657:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787848549.293671:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de9cc26f/0x9aeb41e0543cc6df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.293685:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030200 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.293689:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de9cc26f/0x9aeb41e0543cc6df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.293700:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de9cc26f/0x9aeb41e0543cc6df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.293737:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de9cc26f/0x9aeb41e0543cc6df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.293746:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de9cc26f/0x9aeb41e0543cc6df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.293770:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848549.293774:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093ca8c0c/0x9aeb41e0543cc6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.293780:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148da00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.293783:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ca8c0c/0x9aeb41e0543cc6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.293791:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ca8c0c/0x9aeb41e0543cc6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.293809:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093ca8c0c/0x9aeb41e0543cc6e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.293815:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093ca8c0c/0x9aeb41e0543cc6e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.293829:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.293831:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.293832:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848549.294133:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.294523:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.294531:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6630546/0x9aeb41e0543cc6ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.294544:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.294549:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.294555:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6630546/0x9aeb41e0543cc6ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.294567:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6630546/0x9aeb41e0543cc6ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.294598:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6630546/0x9aeb41e0543cc6ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.294606:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6630546/0x9aeb41e0543cc6ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.294622:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787848549.295091:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.295097:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7bf890/0x9aeb41e0543cc6f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.295106:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.295109:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.295113:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e7bf890/0x9aeb41e0543cc6f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.295122:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e7bf890/0x9aeb41e0543cc6f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.295129:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7bf890/0x9aeb41e0543cc6f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.295136:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e7bf890/0x9aeb41e0543cc6f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.295167:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787848549.295586:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.295592:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091eed809/0x9aeb41e0543cc6fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.295600:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.295604:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.295608:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091eed809/0x9aeb41e0543cc6fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.295615:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091eed809/0x9aeb41e0543cc6fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.295622:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091eed809/0x9aeb41e0543cc6fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.295628:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091eed809/0x9aeb41e0543cc6fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.295636:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787848549.295816:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787848549.295822:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6630546/0x9aeb41e0543cc6ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295830:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.295833:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6630546/0x9aeb41e0543cc6ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295842:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6630546/0x9aeb41e0543cc6ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295855:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6630546/0x9aeb41e0543cc6ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295861:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6630546/0x9aeb41e0543cc6ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295889:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787848549.295893:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e7bf890/0x9aeb41e0543cc6f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295900:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.295903:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7bf890/0x9aeb41e0543cc6f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295910:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7bf890/0x9aeb41e0543cc6f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295921:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e7bf890/0x9aeb41e0543cc6f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295929:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e7bf890/0x9aeb41e0543cc6f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295941:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848549.295944:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091eed809/0x9aeb41e0543cc6fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295963:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148d400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.295966:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091eed809/0x9aeb41e0543cc6fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295984:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091eed809/0x9aeb41e0543cc6fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.295994:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091eed809/0x9aeb41e0543cc6fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.296001:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091eed809/0x9aeb41e0543cc6fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.296013:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.296015:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.296016:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.297418:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.297429:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2531be7/0x9aeb41e0543cc702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.297444:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.297457:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.297463:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2531be7/0x9aeb41e0543cc702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.297476:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2531be7/0x9aeb41e0543cc702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.297485:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2531be7/0x9aeb41e0543cc702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.297493:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2531be7/0x9aeb41e0543cc702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.297521:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787848549.297620:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848549.297626:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2531be7/0x9aeb41e0543cc702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.297635:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148ca00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.297654:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2531be7/0x9aeb41e0543cc702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.297663:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2531be7/0x9aeb41e0543cc702 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.297679:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2531be7/0x9aeb41e0543cc702 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.297697:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2531be7/0x9aeb41e0543cc702 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.297714:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.297715:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.297717:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848549.299842:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.303076:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.303091:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cc709 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.303110:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.303114:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.303121:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cc709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.303136:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cc709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.303147:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cc709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.303163:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cc709 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.303189:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787848549.304369:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848549.304381:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cc709 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.304393:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff4148c800 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848549.304397:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cc709 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.304407:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cc709 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.304428:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cc709 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.304435:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e37758/0x9aeb41e0543cc709 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.304456:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848549.304457:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848549.304459:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.324911:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.324956:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018500e2a/0x9aeb41e0543cc710 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.324977:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.324982:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.324989:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018500e2a/0x9aeb41e0543cc710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.325005:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018500e2a/0x9aeb41e0543cc710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.325016:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018500e2a/0x9aeb41e0543cc710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.325023:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018500e2a/0x9aeb41e0543cc710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787848549.325033:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787848549.325046:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787848549.325058:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848549.325064:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018500e2a/0x9aeb41e0543cc710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.325071:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b57600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848549.325076:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018500e2a/0x9aeb41e0543cc710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.325085:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018500e2a/0x9aeb41e0543cc710 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.325110:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018500e2a/0x9aeb41e0543cc710 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.325117:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018500e2a/0x9aeb41e0543cc710 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.325136:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848549.325139:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848549.325140:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.330043:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.330058:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b376b63b/0x9aeb41e0543cc717 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.330076:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.330081:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.330087:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b376b63b/0x9aeb41e0543cc717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.330100:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b376b63b/0x9aeb41e0543cc717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.330110:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b376b63b/0x9aeb41e0543cc717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.330117:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b376b63b/0x9aeb41e0543cc717 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.330158:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787848549.330849:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848549.330858:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b376b63b/0x9aeb41e0543cc717 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.330869:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b57000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848549.330873:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b376b63b/0x9aeb41e0543cc717 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.330883:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b376b63b/0x9aeb41e0543cc717 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.330920:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b376b63b/0x9aeb41e0543cc717 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.330929:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b376b63b/0x9aeb41e0543cc717 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.330959:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848549.330961:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848549.330963:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.334329:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.334342:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8c7dee/0x9aeb41e0543cc71e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.334361:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.334366:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.334374:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df8c7dee/0x9aeb41e0543cc71e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.334390:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df8c7dee/0x9aeb41e0543cc71e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.334402:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8c7dee/0x9aeb41e0543cc71e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.334411:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df8c7dee/0x9aeb41e0543cc71e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.334438:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787848549.337444:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848549.337463:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df8c7dee/0x9aeb41e0543cc71e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.337479:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b57800 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.337485:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8c7dee/0x9aeb41e0543cc71e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.337497:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8c7dee/0x9aeb41e0543cc71e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.337519:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df8c7dee/0x9aeb41e0543cc71e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.337528:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df8c7dee/0x9aeb41e0543cc71e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.337551:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.337553:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.337555:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.339692:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.339706:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eff1567/0x9aeb41e0543cc725 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.339800:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.339813:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.339821:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eff1567/0x9aeb41e0543cc725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.339836:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eff1567/0x9aeb41e0543cc725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.339849:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eff1567/0x9aeb41e0543cc725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.339859:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eff1567/0x9aeb41e0543cc725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.339884:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787848549.340422:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.340430:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000805a1202/0x9aeb41e0543cc72c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.340440:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.340444:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.340448:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000805a1202/0x9aeb41e0543cc72c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.340458:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000805a1202/0x9aeb41e0543cc72c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.340466:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000805a1202/0x9aeb41e0543cc72c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.340481:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000805a1202/0x9aeb41e0543cc72c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.340507:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787848549.340939:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787848549.340958:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eff1567/0x9aeb41e0543cc725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.340967:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b56c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848549.340971:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eff1567/0x9aeb41e0543cc725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.340980:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eff1567/0x9aeb41e0543cc725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.341004:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eff1567/0x9aeb41e0543cc725 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.341012:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eff1567/0x9aeb41e0543cc725 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.341033:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848549.341036:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000805a1202/0x9aeb41e0543cc72c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.341042:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b57e00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848549.341046:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000805a1202/0x9aeb41e0543cc72c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.341060:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000805a1202/0x9aeb41e0543cc72c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.341071:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000805a1202/0x9aeb41e0543cc72c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.341078:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000805a1202/0x9aeb41e0543cc72c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.341091:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848549.341092:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848549.341094:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848549.342911:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.345184:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.345196:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893cca7f/0x9aeb41e0543cc733 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.345228:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.345233:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.345239:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893cca7f/0x9aeb41e0543cc733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.345254:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893cca7f/0x9aeb41e0543cc733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.345277:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893cca7f/0x9aeb41e0543cc733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.345285:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893cca7f/0x9aeb41e0543cc733 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.345313:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787848549.345554:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848549.345564:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893cca7f/0x9aeb41e0543cc733 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.345573:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b56e00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848549.345578:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893cca7f/0x9aeb41e0543cc733 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.345587:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893cca7f/0x9aeb41e0543cc733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.345606:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893cca7f/0x9aeb41e0543cc733 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.345627:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893cca7f/0x9aeb41e0543cc733 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.345666:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848549.345668:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848549.345670:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.359402:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.359420:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daffe218/0x9aeb41e0543cc73a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.359448:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.359453:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.359460:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daffe218/0x9aeb41e0543cc73a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.359476:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daffe218/0x9aeb41e0543cc73a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.359487:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daffe218/0x9aeb41e0543cc73a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.359494:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daffe218/0x9aeb41e0543cc73a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.359877:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787848549.359980:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848549.359989:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daffe218/0x9aeb41e0543cc73a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.359998:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b57c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848549.360003:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daffe218/0x9aeb41e0543cc73a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.360012:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daffe218/0x9aeb41e0543cc73a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.360028:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daffe218/0x9aeb41e0543cc73a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.360035:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daffe218/0x9aeb41e0543cc73a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.360053:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848549.360054:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848549.360056:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.361094:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.361104:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d8b2d7c/0x9aeb41e0543cc741 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.361115:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.361118:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.361123:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d8b2d7c/0x9aeb41e0543cc741 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.361133:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d8b2d7c/0x9aeb41e0543cc741 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.361153:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d8b2d7c/0x9aeb41e0543cc741 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.361160:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d8b2d7c/0x9aeb41e0543cc741 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.361183:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787848549.362905:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848549.362916:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d8b2d7c/0x9aeb41e0543cc741 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.362929:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b56400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848549.362933:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d8b2d7c/0x9aeb41e0543cc741 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.362942:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d8b2d7c/0x9aeb41e0543cc741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.362973:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d8b2d7c/0x9aeb41e0543cc741 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.362981:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d8b2d7c/0x9aeb41e0543cc741 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848549.363004:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848549.363006:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848549.363008:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848549.370920:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.370935:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305f7cf6/0x9aeb41e0543cc748 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.370966:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.370972:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.370980:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000305f7cf6/0x9aeb41e0543cc748 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.370994:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000305f7cf6/0x9aeb41e0543cc748 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.371004:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305f7cf6/0x9aeb41e0543cc748 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.371011:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000305f7cf6/0x9aeb41e0543cc748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.371052:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787848549.371590:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848549.371597:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b5bf588/0x9aeb41e0543cc74f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.371607:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787848549.371611:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848549.371616:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b5bf588/0x9aeb41e0543cc74f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.371626:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b5bf588/0x9aeb41e0543cc74f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.371634:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b5bf588/0x9aeb41e0543cc74f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.371666:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b5bf588/0x9aeb41e0543cc74f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.371689:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787848549.371706:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787848549.371712:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000305f7cf6/0x9aeb41e0543cc748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787848549.372283:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848549.372291:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048d2493b/0x9aeb41e0543cc756 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.372299:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1787848549.372303:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848549.372307:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048d2493b/0x9aeb41e0543cc756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.372316:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048d2493b/0x9aeb41e0543cc756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.372323:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048d2493b/0x9aeb41e0543cc756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.372330:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048d2493b/0x9aeb41e0543cc756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.372346:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787848549.372434:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:1.0:1787848549.374243:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848549.374254:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc75d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.374269:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1787848549.374274:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848549.374279:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc75d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.374292:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc75d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.374302:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc75d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.374309:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc75d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.374320:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787848549.375594:0:15400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787848549.375607:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b5bf588/0x9aeb41e0543cc74f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.375620:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b56800 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.375624:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b5bf588/0x9aeb41e0543cc74f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.375635:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b5bf588/0x9aeb41e0543cc74f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.375670:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b5bf588/0x9aeb41e0543cc74f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.375678:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b5bf588/0x9aeb41e0543cc74f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.375700:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848549.375703:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc75d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.375710:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.375713:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc75d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.375720:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc75d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.375743:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc75d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.375751:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc75d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.375764:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.375766:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.375768:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848549.377035:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848549.377046:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc764 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.377061:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1787848549.377074:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848549.377080:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.377092:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.377100:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.377108:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.377130:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787848549.377392:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848549.377407:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.377416:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.377419:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.377427:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.377442:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc764 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.377449:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc764 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.377491:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.377492:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.377494:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848549.377621:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b57400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848549.377633:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000305f7cf6/0x9aeb41e0543cc748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.377657:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000305f7cf6/0x9aeb41e0543cc748 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.377668:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000305f7cf6/0x9aeb41e0543cc748 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.377675:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000305f7cf6/0x9aeb41e0543cc748 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848549.377691:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848549.377693:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848549.377694:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848549.380962:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848549.380977:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007806c97c/0x9aeb41e0543cc76b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.380995:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1787848549.380999:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848549.381006:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007806c97c/0x9aeb41e0543cc76b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.381019:0:15026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007806c97c/0x9aeb41e0543cc76b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.381030:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007806c97c/0x9aeb41e0543cc76b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.381045:0:15026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007806c97c/0x9aeb41e0543cc76b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848549.381076:0:15026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787848549.381384:0:15026:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1787848549.381474:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79190780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14366:x1874694631431808:12345-0@lo:5:osp-pre-0-0.0 Request processed in 146099us (146523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848549.381489:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787848549.382082:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79190000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14366:1874694631431808:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787848549.382099:0:14366:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1787848549.382148:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79190000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14366:1874694631431936:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787848549.382187:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848549.382244:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f692900 going to sleep for 11 seconds 00000100:00100000:0.0:1787848549.382374:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631431936 00000100:00100000:0.0:1787848549.382381:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631431936 00000100:00100000:0.0:1787848549.382418:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787848549.382428:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79192580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14366:x1874694631431936:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787848549.382466:0:15028:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1787848549.382982:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787848549.382991:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007806c97c/0x9aeb41e0543cc76b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.383002:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e800 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.383006:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007806c97c/0x9aeb41e0543cc76b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.383017:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007806c97c/0x9aeb41e0543cc76b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.383036:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007806c97c/0x9aeb41e0543cc76b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.383045:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007806c97c/0x9aeb41e0543cc76b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.383067:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.383069:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.383071:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.392048:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.392063:0:15400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048d2493b/0x9aeb41e0543cc756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.392091:0:15400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848549.392096:0:15400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048d2493b/0x9aeb41e0543cc756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.392107:0:15400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048d2493b/0x9aeb41e0543cc756 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.392131:0:15400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048d2493b/0x9aeb41e0543cc756 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.392138:0:15400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048d2493b/0x9aeb41e0543cc756 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848549.392158:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.392160:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.392162:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.392167:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848549.392169:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848549.395588:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79192580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14366:x1874694631431936:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13154us (13393us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787848549.395609:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848549.395736:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79190000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14366:1874694631431936:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787848549.395760:0:14366:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1787848549.552057:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848550.582888:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848551.605866:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787848551.967103:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787848551.967162:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787848552.623939:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848553.652359:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787848554.356042:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787848554.356051:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787848554.356057:0:8:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787848554.356067:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1787848554.356075:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787848554.356084:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ff80247800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:0.0:1787848554.356117:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff79192940 x1874694631432320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787848554.356219:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631432192:0@lo:400:kworker.0 00000100:00100000:0.0:1787848554.356329:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848554.356411:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848554.356418:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79193840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631432064:0@lo:400:kworker.0 00000100:00100000:0.0:1787848554.356454:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848554.356488:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631432320:0@lo:8:kworker.0 00000100:00100000:0.0:1787848554.356517:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848554.356548:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631432448:0@lo:400:kworker.0 00000100:00100000:0.0:1787848554.356579:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848554.356598:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787848554.356603:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631432576:0@lo:400:kworker.0 00000100:00100000:0.0:1787848554.356627:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848554.356718:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631432192 00000100:00100000:0.0:1787848554.356728:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631432192 00000100:00100000:0.0:1787848554.356790:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631432320 00000100:00100000:0.0:1787848554.356794:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631432320 00000100:00100000:0.0:1787848554.356808:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848554.356818:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631432192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848554.356891:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631432192:12345-0@lo:400:kworker.0 Request processed in 75us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848554.356900:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787848554.356921:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787848554.356925:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874694631432320:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787848554.356947:0:15026:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787848554.359076:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631432064 00000100:00100000:2.0:1787848554.359094:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631432064 00000100:00100000:2.0:1787848554.359197:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787848554.359209:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:3313:x1874694631432064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848554.359332:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:3313:x1874694631432064:12345-0@lo:400:kworker.0 Request processed in 125us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848554.359361:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787848554.359410:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631432448 00000100:00100000:2.0:1787848554.359415:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631432448 00000100:00100000:2.0:1787848554.359451:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631432576 00000100:00100000:2.0:1787848554.359455:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631432576 00000100:00100000:2.0:1787848554.359488:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848554.359494:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631432448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848554.359542:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631432448:12345-0@lo:400:kworker.0 Request processed in 48us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848554.359550:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848554.359562:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787848554.359568:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631432576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848554.359600:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631432576:12345-0@lo:400:kworker.0 Request processed in 33us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848554.359606:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787848554.359623:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787848554.359629:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787848554.359706:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff807e0f00 x1874694631432576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848554.359725:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631432576:0@lo:400:kworker.0 00010000:00080000:2.0:1787848554.359741:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff791921c0 x1874694631432448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848554.359751:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631432448:0@lo:400:kworker.0 00000100:00100000:2.0:1787848554.363795:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79195a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631432704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787848554.363926:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848554.364165:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631432704 00000100:00100000:1.0:1787848554.364184:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631432704 00000100:00100000:1.0:1787848554.364257:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787848554.364269:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631432704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848554.364320:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848554.364379:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631432704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848554.364386:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787848554.364545:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787848554.364576:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79195a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631432704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787848554.382806:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79193840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631432064:0@lo:400:kworker.0 00000100:00100000:2.0:1787848554.382853:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631432192:0@lo:400:kworker.0 00000100:00100000:0.0:1787848554.390810:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874694631432320:12345-0@lo:8:kworker.0 Request processed in 33870us (34278us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787848554.390831:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787848554.407037:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787848554.407055:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787848554.407060:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79192940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631432320:0@lo:8:kworker.0 00010000:00010000:1.0:1787848554.671758:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848555.696050:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787848556.147127:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787848556.719983:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848557.745172:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848558.770724:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787848559.475249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787848559.475267:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787848559.475273:0:36:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787848559.475283:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:0.0:1787848559.475291:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787848559.475300:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ff80247800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:0.0:1787848559.475331:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff807e3c00 x1874694631433088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787848559.477661:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631433344:0@lo:400:kworker.0 00000100:00100000:1.0:1787848559.479612:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848559.480463:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631433344 00000100:00100000:2.0:1787848559.480479:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631433344 00000100:00100000:2.0:1787848559.480568:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787848559.480580:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79196580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631433344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848559.480689:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79196580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631433344:12345-0@lo:400:kworker.0 Request processed in 111us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848559.480697:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787848559.481973:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff807e0000 x1874694631433344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848559.481995:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631433344:0@lo:400:kworker.0 00000100:00100000:1.0:1787848559.482027:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787848559.482042:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631432832:0@lo:400:kworker.0 00000100:00100000:1.0:1787848559.482105:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848559.482167:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631433216:0@lo:400:kworker.0 00000100:00100000:1.0:1787848559.482196:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848559.482888:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787848559.482898:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631432960:0@lo:400:kworker.0 00000100:00100000:1.0:1787848559.482934:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848559.482970:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631433088:0@lo:8:kworker.0 00000100:00100000:1.0:1787848559.482998:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848559.486063:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631432960 00000100:00100000:3.0:1787848559.486089:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631432960 00000100:00100000:3.0:1787848559.486187:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631433088 00000100:00100000:3.0:1787848559.486192:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631433088 00000100:00100000:3.0:1787848559.486244:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787848559.486257:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79194780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631432960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848559.486392:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79194780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631432960:12345-0@lo:400:kworker.0 Request processed in 138us (3456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848559.486400:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787848559.486421:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787848559.486426:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79196d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874694631433088:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787848559.486449:0:15028:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787848559.486881:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631432832 00000100:00100000:1.0:1787848559.486887:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631432832 00000100:00100000:1.0:1787848559.486935:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787848559.486944:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:3312:x1874694631432832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848559.486989:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:3312:x1874694631432832:12345-0@lo:400:kworker.0 Request processed in 47us (4885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848559.486995:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787848559.487042:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631433216 00000100:00100000:1.0:1787848559.487047:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631433216 00000100:00100000:1.0:1787848559.487075:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787848559.487082:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631433216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848559.487117:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631433216:12345-0@lo:400:kworker.0 Request processed in 36us (4921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848559.487138:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787848559.487198:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631432960:0@lo:400:kworker.0 00010000:00080000:1.0:1787848559.487215:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ff807e3480 x1874694631433216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787848559.487227:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631433216:0@lo:400:kworker.0 00000100:00100000:1.0:1787848559.487289:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631432832:0@lo:400:kworker.0 00000100:00100000:1.0:1787848559.487303:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787848559.487315:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631433472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848559.487352:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848559.487389:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631433472 00000100:00100000:1.0:1787848559.487392:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631433472 00000100:00100000:1.0:1787848559.487418:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787848559.487425:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79194b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631433472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787848559.487458:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848559.487493:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79194b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631433472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848559.487499:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787848559.487528:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631433472:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787848559.488995:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787848559.489007:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848559.547819:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79196d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874694631433088:12345-0@lo:8:kworker.0 Request processed in 61374us (64802us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787848559.547841:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787848559.551302:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787848559.551324:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787848559.551357:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631433088:0@lo:8:kworker.0 00010000:00010000:2.0:1787848559.794931:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787848560.503696:0:15746:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787848560.503702:0:15746:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787848560.503847:0:15746:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93ff4306e000 00000020:01000004:0.0:1787848560.503868:0:15746:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787848560.503886:0:15746:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787848560.503905:0:15746:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93ff7939b3a0) 00000020:00000080:0.0:1787848560.503929:0:15746:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787848560.588105:0:15746:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787848560.588407:0:15746:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787848560.589260:0:15746:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787848560.589488:0:15746:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787848560.596498:0:15746:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787848560.618879:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 417: rc = 0 00100000:10000000:2.0:1787848560.620849:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 417: rc = 0 00100000:10000000:2.0:1787848560.626724:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 417: rc = 0 00100000:10000000:2.0:1787848560.630793:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 581: rc = 0 00100000:10000000:2.0:1787848560.634614:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 581: rc = 0 00100000:10000000:2.0:1787848560.637627:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 581: rc = 0 00100000:10000000:2.0:1787848560.642896:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 581: rc = 0 00100000:10000000:2.0:1787848560.650597:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 581: rc = 0 00100000:10000000:2.0:1787848560.650997:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 581: rc = 0 00000020:00000080:2.0:1787848560.658330:0:15746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787848560.658354:0:15746:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787848560.658380:0:15746:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aeb41e0543cc779 00000020:01000004:2.0:1787848560.658395:0:15746:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787848560.658428:0:15746:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787848560.658433:0:15746:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787848560.658441:0:15746:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787848560.658474:0:15746:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787848560.658479:0:15746:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787848560.707973:0:15746:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787848560.708029:0:15746:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.126@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787848560.708036:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787848560.708037:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787848560.709332:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848560.709342:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848560.709343:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848560.709346:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848560.709348:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848560.709351:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848560.709353:0:15746:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787848560.709359:0:15746:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787848560.709363:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787848560.709365:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787848560.709366:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848560.709368:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848560.709369:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848560.709370:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848560.709371:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848560.709373:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848560.709374:0:15746:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787848560.709416:0:15746:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787848560.709446:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631433600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787848560.709561:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.709658:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff45721cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848560.711425:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631433600 00000100:00100000:0.0:1787848560.711444:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631433600 00000100:00100000:0.0:1787848560.711535:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787848560.711548:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15746:x1874694631433600:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787848560.711604:0:14337:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787848560.711608:0:14337:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787848560.711613:0:14337:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787848560.738831:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15746:x1874694631433600:12345-0@lo:253:mount.lustre.0 Request processed in 27270us (29254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848560.738852:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787848560.741505:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631433600:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787848560.741533:0:15746:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787848560.741563:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787848560.741565:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787848560.741567:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787848560.741568:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787848560.741569:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787848560.741571:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787848560.741573:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787848560.741574:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787848560.741576:0:15746:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787848560.741610:0:15746:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93ff4306e000 from lustre-OST0001 10000000:01000000:2.0:1787848560.741702:0:15746:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787848560.741706:0:15746:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787848560.741719:0:15746:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93ff7fcc99d0 local copy 00010000:00010000:2.0:1787848560.741737:0:15746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc526 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848560.742109:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631433728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848560.742190:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.742245:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff457219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848560.744252:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631433728 00000100:00100000:0.0:1787848560.744271:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631433728 00000100:00100000:0.0:1787848560.744359:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787848560.744369:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15746:x1874694631433728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787848560.745202:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15746:x1874694631433728:12345-0@lo:501:mount.lustre.0 Request processed in 831us (3008us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787848560.745213:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787848560.746364:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631433728:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787848560.746398:0:15746:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787848560.746724:0:15746:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787848560.746735:0:15746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc526 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848560.746747:0:15746:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff5f42fe00/0x9aeb41e0543cc51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc526 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848560.746810:0:15746:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ff4306e000 10000000:01000000:2.0:1787848560.746816:0:15746:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787848560.746823:0:15746:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787848560.746835:0:15746:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787848560.746842:0:15746:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787848560.746845:0:15746:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787848560.746895:0:15746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664200/0x9aeb41e0543cc780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848560.746904:0:15746:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50664200/0x9aeb41e0543cc780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848560.746917:0:15746:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50664200/0x9aeb41e0543cc780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848560.747818:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631433856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787848560.747929:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848560.748832:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff457219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848560.757989:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631433856 00000100:00100000:0.0:1787848560.758017:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631433856 00000100:00100000:0.0:1787848560.758366:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787848560.758382:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:15746:x1874694631433856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787848560.758431:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848560.758458:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93fe41b57e00/0x9aeb41e0543cc787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc780 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848560.758494:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93fe41b57e00/0x9aeb41e0543cc787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc780 expref: 17 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848560.758506:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93fe41b57e00/0x9aeb41e0543cc787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc780 expref: 17 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848560.758518:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b57e00, rc 0) 00000100:00100000:0.0:1787848560.758770:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:15746:x1874694631433856:12345-0@lo:101:mount.lustre.0 Request processed in 263us (10711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848560.758778:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787848560.759052:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631433856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787848560.759077:0:15746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50664200/0x9aeb41e0543cc780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc787 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848560.759089:0:15746:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50664200/0x9aeb41e0543cc780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc787 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787848560.760428:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787848560.765330:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787848560.765701:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787848560.765745:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787848560.766433:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787848560.766496:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787848560.766534:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787848560.766566:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787848560.766695:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787848560.766704:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787848560.766973:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631433984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787848560.767069:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848560.767182:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6eceee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787848560.769331:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631433984 00000100:00100000:0.0:1787848560.769353:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631433984 00000100:00100000:0.0:1787848560.769449:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787848560.769461:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:15746:x1874694631433984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787848560.770455:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:15746:x1874694631433984:12345-0@lo:501:mount.lustre.0 Request processed in 992us (3381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848560.770466:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787848560.777320:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631433984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787848560.777420:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787848560.777536:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848560.777596:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6eceee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787848560.777903:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631434112 00000100:00100000:1.0:1787848560.777911:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631434112 00000100:00100000:1.0:1787848560.777984:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787848560.777994:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:15746:x1874694631434112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787848560.778633:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:15746:x1874694631434112:12345-0@lo:503:mount.lustre.0 Request processed in 636us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848560.778696:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787848560.781026:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787848560.782302:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787848560.782415:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787848560.782513:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848560.782579:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6eceee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787848560.782770:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631434240 00000100:00100000:2.0:1787848560.782780:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631434240 00000100:00100000:2.0:1787848560.782854:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787848560.782864:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:15746:x1874694631434240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787848560.783340:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:15746:x1874694631434240:12345-0@lo:502:mount.lustre.0 Request processed in 476us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848560.783349:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787848560.783493:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434240:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787848560.783992:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787848560.784060:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787848560.784098:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787848560.785076:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787848560.785233:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787848560.785563:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787848560.785611:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787848560.785673:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787848560.785733:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787848560.785832:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787848560.785937:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.786011:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff45721600 going to sleep for 11 seconds 00000100:00100000:1.0:1787848560.786266:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631434368 00000100:00100000:1.0:1787848560.786275:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631434368 00000100:00100000:1.0:1787848560.786348:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787848560.786360:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:15746:x1874694631434368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787848560.786603:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:15746:x1874694631434368:12345-0@lo:502:mount.lustre.0 Request processed in 245us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848560.786612:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787848560.787137:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787848560.787273:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787848560.787291:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787848560.788869:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787848560.788882:0:15747:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787848560.788892:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787848560.788895:0:15747:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787848560.788902:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787848560.788949:0:15747:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93fe41ee0000) 00000020:00000080:2.0:1787848560.788984:0:15747:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787848560.788991:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787848560.789070:0:15747:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ff4306e000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787848560.789079:0:15747:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787848560.789087:0:15747:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aeb41e0543cc795 00010000:00010000:2.0:1787848560.799453:0:15747:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787848560.800085:0:15747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787848560.804580:0:15747:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787848560.810842:0:15747:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787848560.810861:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848560.810870:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848560.810873:0:15747:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787848560.810877:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848560.810882:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848560.810884:0:15747:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787848560.810887:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787848560.810904:0:15747:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787848560.810908:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848560.810911:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848560.810913:0:15747:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787848560.810915:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848560.810918:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848560.810920:0:15747:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787848560.810924:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787848560.811007:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848560.811012:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848560.811014:0:15747:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787848560.811017:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787848560.811433:0:15746:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787848560.811470:0:15746:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787848560.811499:0:15746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664200/0x9aeb41e0543cc780 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc787 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848560.811513:0:15746:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50664200/0x9aeb41e0543cc780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc787 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848560.811534:0:15746:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff4306e000 from 1 10000000:01000000:3.0:1787848560.811537:0:15746:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787848560.811590:0:15746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848560.811599:0:15746:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848560.811613:0:15746:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848560.811670:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787848560.811794:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848560.811841:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6eceee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787848560.814730:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631434496 00000100:00100000:0.0:1787848560.814760:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631434496 00000100:00100000:0.0:1787848560.814831:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787848560.814842:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:15746:x1874694631434496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787848560.814866:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848560.814892:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93fe41b56c00/0x9aeb41e0543cc7a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc79c expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848560.814928:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93fe41b56c00/0x9aeb41e0543cc7a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc79c expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848560.814941:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93fe41b56c00/0x9aeb41e0543cc7a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc79c expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848560.814952:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b56c00, rc 0) 00000100:00100000:0.0:1787848560.815056:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:15746:x1874694631434496:12345-0@lo:101:mount.lustre.0 Request processed in 215us (3263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848560.815064:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787848560.815528:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787848560.815551:0:15746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848560.815563:0:15746:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848560.816998:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787848560.824801:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787848560.829853:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787848560.833981:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787848560.834357:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787848560.834457:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787848560.834467:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787848560.834608:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787848560.837096:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848560.837189:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6eceee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787848560.841176:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631434624 00000100:00100000:2.0:1787848560.841199:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631434624 00000100:00100000:2.0:1787848560.841287:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787848560.841301:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:15746:x1874694631434624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848560.841792:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:15746:x1874694631434624:12345-0@lo:501:mount.lustre.0 Request processed in 492us (5755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848560.841802:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787848560.846995:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787848560.847110:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787848560.847413:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848560.847472:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6eceee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787848560.849393:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631434752 00000100:00100000:1.0:1787848560.849411:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631434752 00000100:00100000:1.0:1787848560.849502:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787848560.849515:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:15746:x1874694631434752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787848560.853091:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:15746:x1874694631434752:12345-0@lo:503:mount.lustre.0 Request processed in 3560us (5661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848560.853113:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787848560.856706:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434752:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787848560.864099:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787848560.864335:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434880:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787848560.864458:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848560.864521:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff6eceee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787848560.865064:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631434880 00000100:00100000:0.0:1787848560.865090:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631434880 00000100:00100000:0.0:1787848560.865176:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787848560.865189:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4579ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:15746:x1874694631434880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787848560.865665:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4579ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:15746:x1874694631434880:12345-0@lo:502:mount.lustre.0 Request processed in 450us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848560.865675:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787848560.865706:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631434880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787848560.867345:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787848560.867445:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787848560.867488:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787848560.869353:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787848560.869477:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787848560.870844:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787848560.872482:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787848560.872626:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787848560.872722:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787848560.872871:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848560.878278:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631435008 00000100:00100000:1.0:1787848560.878301:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631435008 00000100:00100000:1.0:1787848560.878411:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787848560.878425:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4579b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:15746:x1874694631435008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787848560.878833:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4579b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:15746:x1874694631435008:12345-0@lo:502:mount.lustre.0 Request processed in 410us (5960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848560.878842:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787848560.883034:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff446e1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787848560.883254:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787848560.883619:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787848560.887347:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787848560.889346:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848560.889365:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848560.889369:0:15751:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787848560.889378:0:15751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ff4306e000 00000020:00000080:0.0:1787848560.889382:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787848560.889392:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848560.889396:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848560.889397:0:15751:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787848560.889400:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848560.889402:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848560.889403:0:15751:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787848560.889406:0:15751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ff4306e000 00000020:00000080:0.0:1787848560.889408:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787848560.889491:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848560.889495:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848560.889496:0:15751:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787848560.889499:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787848560.889501:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848560.889502:0:15751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787848560.889505:0:15751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ff4306e000 00000020:00000080:0.0:1787848560.889507:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787848560.889553:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787848560.889556:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787848560.889557:0:15751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787848560.889560:0:15751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787848560.902379:0:15746:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787848560.902463:0:15746:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787848560.902491:0:15746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848560.902508:0:15746:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848560.904337:0:15746:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787848560.904347:0:15746:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ff4306e000 10000000:01000000:2.0:1787848560.904377:0:15746:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ff4306e000 10000000:01000000:2.0:1787848560.904383:0:15746:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787848560.904394:0:15746:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ff4306e000 from 1 10000000:01000000:2.0:1787848560.904398:0:15746:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787848560.904465:0:15746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664600/0x9aeb41e0543cc7aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848560.904479:0:15746:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50664600/0x9aeb41e0543cc7aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848560.904492:0:15746:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50664600/0x9aeb41e0543cc7aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848560.904525:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787848560.904625:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.904740:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff45721b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787848560.907923:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631435136 00000100:00100000:3.0:1787848560.907944:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631435136 00000100:00100000:3.0:1787848560.908049:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787848560.908062:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff45798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:15746:x1874694631435136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787848560.908091:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848560.908118:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79237400/0x9aeb41e0543cc7b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc7aa expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848560.908181:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79237400/0x9aeb41e0543cc7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc7aa expref: 19 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848560.908195:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79237400/0x9aeb41e0543cc7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc7aa expref: 19 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848560.908207:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237400, rc 0) 00000100:00100000:3.0:1787848560.908307:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff45798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:15746:x1874694631435136:12345-0@lo:101:mount.lustre.0 Request processed in 248us (3682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848560.908316:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787848560.908813:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787848560.908836:0:15746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50664600/0x9aeb41e0543cc7aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc7b1 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848560.908848:0:15746:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50664600/0x9aeb41e0543cc7aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc7b1 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787848560.909764:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787848560.917671:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787848560.920794:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787848560.920908:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787848560.920933:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787848560.920982:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787848560.921022:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787848560.921686:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787848560.921730:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787848560.921778:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787848560.921827:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787848560.921862:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787848560.921894:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787848560.921942:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787848560.921978:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787848560.922012:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787848560.924024:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787848560.924837:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787848560.924938:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787848560.925011:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787848560.927219:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787848560.928292:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787848560.928396:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787848560.928432:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787848560.928466:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787848560.928520:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787848560.928558:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787848560.928589:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787848560.928637:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787848560.928698:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787848560.928729:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787848560.928793:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787848560.928827:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787848560.928857:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787848560.928928:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787848560.928980:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787848560.929015:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787848560.936060:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787848560.936190:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787848560.936303:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787848560.936319:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787848560.936488:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848560.936586:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.936680:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff45721b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787848560.939525:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631435264 00000100:00100000:2.0:1787848560.939547:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631435264 00000100:00100000:2.0:1787848560.939636:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787848560.939667:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:15746:x1874694631435264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848560.940572:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:15746:x1874694631435264:12345-0@lo:501:mount.lustre.0 Request processed in 900us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848560.940586:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787848560.940793:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787848560.940869:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787848560.940926:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.941010:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff45721b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787848560.948677:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631435392 00000100:00100000:3.0:1787848560.948700:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631435392 00000100:00100000:3.0:1787848560.948954:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787848560.948966:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:15746:x1874694631435392:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787848560.949743:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:15746:x1874694631435392:12345-0@lo:503:mount.lustre.0 Request processed in 774us (8811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848560.949768:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787848560.953437:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435392:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787848560.963625:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787848560.963825:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787848560.963958:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.964024:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff45721b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787848560.965731:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631435520 00000100:00100000:3.0:1787848560.965759:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631435520 00000100:00100000:3.0:1787848560.965835:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787848560.965848:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:15746:x1874694631435520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787848560.966477:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:15746:x1874694631435520:12345-0@lo:502:mount.lustre.0 Request processed in 630us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848560.966488:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787848560.970626:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787848560.971242:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787848560.971327:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787848560.971357:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787848560.971401:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787848560.971447:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787848560.971499:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787848560.971536:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787848560.971591:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787848560.971708:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787848560.971758:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787848560.971789:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787848560.971851:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787848560.971890:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787848560.971919:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787848560.971961:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787848560.971998:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787848560.972029:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787848560.972244:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787848560.972281:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787848560.972306:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787848560.972346:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787848560.972373:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787848560.972398:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787848560.972453:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787848560.972489:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787848560.972523:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787848560.972573:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787848560.972608:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787848560.973853:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787848560.974000:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787848560.975021:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787848560.975184:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787848560.975217:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787848560.975281:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787848560.975313:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787848560.975390:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787848560.975420:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787848560.975445:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787848560.975495:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787848560.975533:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787848560.975605:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787848560.976326:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848560.976384:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff48181480 going to sleep for 11 seconds 00000100:00100000:3.0:1787848560.976613:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631435648 00000100:00100000:3.0:1787848560.976624:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631435648 00000100:00100000:3.0:1787848560.976733:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787848560.976743:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:15746:x1874694631435648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787848560.977267:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:15746:x1874694631435648:12345-0@lo:502:mount.lustre.0 Request processed in 524us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848560.977276:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787848560.977493:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631435648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787848560.977803:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787848560.977834:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787848560.982571:0:15756:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787848560.982615:0:15756:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93ff793999d0) 00000020:00000080:0.0:1787848560.982755:0:15756:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787848560.982877:0:15756:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ff4306e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787848560.982882:0:15756:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ff4306e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787848560.982885:0:15756:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ff4306e000 3 00010000:00080000:0.0:1787848560.982923:0:15756:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93fe413b1000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.126@tcp at head 00010000:00010000:1.0:1787848560.987125:0:15756:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787848560.987416:0:15756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787848560.987478:0:15756:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787848560.987498:0:15756:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9aeb41e0543cc7bf 00000100:00080000:1.0:1787848560.987513:0:15756:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787848560.987522:0:15756:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93fe413b1000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:1.0:1787848560.987576:0:15756:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff79197840 x1874694631435776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787848560.987608:0:15756:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787848560.987857:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787848560.987863:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787848560.987866:0:36:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787848560.987872:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:3.0:1787848560.987876:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787848560.987880:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ff80247800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787848560.987895:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff7fd5f840 x1874694631436032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787848560.987954:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631436288:0@lo:400:kworker.0 00000100:00100000:3.0:1787848560.988052:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.990369:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874694631435776:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787848560.990463:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.990533:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631436032:0@lo:8:kworker.0 00000100:00100000:2.0:1787848560.990569:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.990610:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631435904:0@lo:400:kworker.0 00000100:00100000:2.0:1787848560.990678:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.990712:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787848560.990721:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631436160:0@lo:400:kworker.0 00000100:00100000:2.0:1787848560.990754:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848560.990796:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631436288 00000100:00100000:2.0:1787848560.990806:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631436288 00000100:00100000:2.0:1787848560.990868:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631435776 00000100:00100000:2.0:1787848560.990872:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631435776 00000100:00100000:2.0:1787848560.990883:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631436160 00000100:00100000:2.0:1787848560.990886:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631436160 00000100:00100000:2.0:1787848560.990906:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787848560.990916:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631436288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848560.990986:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631436288:12345-0@lo:400:kworker.0 Request processed in 71us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848560.990995:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787848560.991013:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787848560.991018:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631436160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848560.991061:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874694631436160:12345-0@lo:400:kworker.0 Request processed in 42us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848560.991067:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787848560.991080:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787848560.991084:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874694631435776:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787848560.991114:0:14344:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:2.0:1787848560.991166:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9aeb41e0543cc7c6 00000004:00100000:2.0:1787848560.991188:0:14344:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787848560.991230:0:14344:0:(import.c:65:import_set_state_nolock()) ffff93ff7fa79000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787848560.991268:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874694631435776:12345-0@lo:38:llog_process_th.0 Request processed in 183us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848560.991282:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787848560.991311:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631436032 00000100:00100000:2.0:1787848560.991315:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631436032 00000100:00100000:2.0:1787848560.991327:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631435904 00000100:00100000:2.0:1787848560.991329:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631435904 00000100:00100000:2.0:1787848560.991344:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787848560.991349:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631435904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848560.991379:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631435904:12345-0@lo:400:kworker.0 Request processed in 30us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848560.991384:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787848560.991393:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787848560.991396:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1874694631436032:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787848560.991423:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1874694631436032:12345-0@lo:8:kworker.0 Request processed in 26us (854us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787848560.991428:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787848560.991469:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fd5d2c0 x1874694631436160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848560.991486:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874694631436160:0@lo:400:kworker.0 00000100:00100000:2.0:1787848560.991500:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631435904:0@lo:400:kworker.0 00010000:00080000:2.0:1787848560.991535:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff79197840 x1874694631435776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787848570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848560.991543:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787848560.991551:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787848560.991561:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787848560.991567:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787848560.991579:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93fe413b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787848560.991587:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874694631435776:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787848560.991602:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787848560.991607:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787848560.991611:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787848560.991614:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631436032:0@lo:8:kworker.0 00010000:00080000:3.0:1787848560.995446:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7fd5f480 x1874694631436288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787848560.995471:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631436288:0@lo:400:kworker.0 00000040:00080000:0.0:1787848560.997350:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787848560.997513:0:15746:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787848560.997554:0:15746:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787848560.997574:0:15746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664600/0x9aeb41e0543cc7aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc7b1 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848560.997587:0:15746:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50664600/0x9aeb41e0543cc7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc7b1 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787848560.997677:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787848560.997680:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787848560.997681:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787848560.997683:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787848560.997684:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787848560.997686:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787848560.997688:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787848560.997690:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787848560.997692:0:15746:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787848560.997697:0:15746:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787848560.997700:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787848560.997702:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787848560.997703:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787848560.997704:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787848560.997712:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787848560.997713:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787848560.997714:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787848560.997715:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787848560.997716:0:15746:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787848560.997781:0:15746:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787848560.997809:0:15746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79194000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631436416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787848560.997900:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848560.998864:0:15746:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff48181840 going to sleep for 11 seconds 00000100:00100000:3.0:1787848560.998954:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631436416 00000100:00100000:3.0:1787848560.998964:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631436416 00000100:00100000:3.0:1787848560.999148:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787848560.999162:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:15746:x1874694631436416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787848560.999207:0:14338:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787848560.999227:0:14338:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787848561.039269:0:14338:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787848561.039319:0:14338:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787848561.039346:0:14359:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787848561.039352:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787848561.039382:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.039406:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc699 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.039416:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.039468:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cc699 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.039488:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc6a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cc699 expref: 19 pid: 14337 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848561.039509:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1874694631436544:0@lo:104: 00000100:00100000:3.0:1787848561.039606:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848561.039692:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f691e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787848561.039722:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631436544 00000100:00100000:3.0:1787848561.039731:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631436544 00000100:00100000:3.0:1787848561.039800:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848561.039810:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+3:14359:x1874694631436544:12345-0@lo:104: 00010000:00010000:3.0:1787848561.039826:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.039890:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787848561.039897:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+3:14359:x1874694631436544:12345-0@lo:104: Request processed in 89us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848561.039915:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787848561.039946:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848561.039954:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.039962:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236a00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:3.0:1787848561.039966:0:14331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.039977:0:14331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787848561.039987:0:14331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787848561.039995:0:14331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787848561.040032:0:14331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040038:0:14331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787848561.040060:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040067:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff79236a00/0x9aeb41e0543cc699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc6a0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040090:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848561.040092:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848561.040093:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848561.040115:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631436672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787848561.040155:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848561.040214:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631436672 00000100:00100000:3.0:1787848561.040218:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631436672 00010000:00010000:3.0:1787848561.040236:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc6a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc699 expref: 20 pid: 14337 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848561.040259:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848561.040264:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+20:3313:x1874694631436672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848561.040276:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848561.040280:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc6a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc699 expref: 20 pid: 14337 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040290:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc6a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cc699 expref: 20 pid: 14337 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040308:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040317:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787848561.040330:0:14328:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001035943s 00010000:00010000:3.0:1787848561.040334:0:14328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040342:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040348:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040363:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040369:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79236400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848561.040372:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040380:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040388:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040397:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848561.040422:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+20:3313:x1874694631436672:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848561.040428:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787848561.040596:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631436672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787848561.040626:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc6a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cc699 expref: 19 pid: 14337 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848561.040636:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1874694631436544:0@lo:104: 00010000:00010000:3.0:1787848561.040679:0:14359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040688:0:14359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040706:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848561.040714:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff79236400/0x9aeb41e0543cc7cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848561.048924:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:15746:x1874694631436416:12345-0@lo:253:mount.lustre.0 Request processed in 49750us (51008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848561.048945:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787848561.049251:0:15746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79194000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ee33ef1-6a45-464a-a8ac-d296b849f06b:15746:1874694631436416:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787848561.049273:0:15746:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787848561.049277:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787848561.049279:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787848561.049281:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787848561.049282:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787848561.049284:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787848561.049286:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787848561.049288:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787848561.049291:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787848561.049292:0:15746:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787848561.049321:0:15746:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787848561.053261:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787848561.053452:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787848561.053625:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787848561.053833:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787848561.053983:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787848561.054219:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787848561.056357:0:15746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787848561.112859:0:15746:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787848561.112874:0:15746:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787848561.112919:0:15746:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787848561.113009:0:15746:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787848561.113172:0:15746:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787848561.113214:0:15746:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787848561.839784:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787848562.096267:0:14340:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787848562.096291:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ff5ede2000 from 8 10000000:01000000:3.0:1787848562.096298:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787848562.096362:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236400/0x9aeb41e0543cc7d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848562.096376:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff79236400/0x9aeb41e0543cc7d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848562.096390:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff79236400/0x9aeb41e0543cc7d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848562.096424:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631436800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787848562.096544:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848562.096675:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff50537c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787848562.097155:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631436800 00000100:00100000:2.0:1787848562.097166:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631436800 00000100:00100000:2.0:1787848562.097237:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787848562.097248:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:14340:x1874694631436800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848562.097267:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848562.097286:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50665600/0x9aeb41e0543cc7db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc7d4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848562.097316:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50665600/0x9aeb41e0543cc7db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc7d4 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848562.097326:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50665600/0x9aeb41e0543cc7db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc7d4 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848562.097336:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665600, rc 0) 00000100:00100000:2.0:1787848562.097384:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:14340:x1874694631436800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848562.097391:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787848562.098866:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631436800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787848562.098903:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff79236400/0x9aeb41e0543cc7d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc7db expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848562.098915:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff79236400/0x9aeb41e0543cc7d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc7db expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848562.099029:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631436928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787848562.100306:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848562.100421:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff50537c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787848562.109243:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631436928 00000100:00100000:2.0:1787848562.109266:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631436928 00000100:00100000:3.0:1787848562.118801:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787848562.118820:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:14340:x1874694631436928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787848562.118862:0:14337:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787848562.118882:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787848562.118887:0:14337:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787848562.119961:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:14340:x1874694631436928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1136us (19653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848562.119975:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787848562.122206:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631436928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787848562.122384:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787848562.122399:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff79236400/0x9aeb41e0543cc7d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc7db expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848562.122413:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff79236400/0x9aeb41e0543cc7d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc7db expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848562.864127:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848563.887878:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848564.594459:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787848564.594502:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631437056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787848564.594602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848564.598967:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631437056 00000100:00100000:2.0:1787848564.598990:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631437056 00000100:00100000:2.0:1787848564.599109:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787848564.599123:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631437056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848564.599177:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848564.599299:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631437056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (4696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848564.599306:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787848564.599944:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787848564.600014:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631437056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787848564.922813:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848565.935888:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787848566.139502:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787848566.139512:0:482:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787848566.139517:0:482:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787848566.139532:0:482:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ff80247800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787848566.139561:0:482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ff79249e00 x1874694631437440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787848566.139670:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631437696:0@lo:400:kworker.0 00000100:00100000:2.0:1787848566.139764:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848566.140094:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787848566.140103:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7924a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631437184:0@lo:400:kworker.0 00000100:00100000:2.0:1787848566.140139:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848566.140165:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631437824:0@lo:400:kworker.0 00000100:00100000:2.0:1787848566.140187:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848566.140216:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631437312:0@lo:400:kworker.0 00000100:00100000:2.0:1787848566.140246:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848566.140281:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848566.140288:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631437568:0@lo:400:kworker.0 00000100:00100000:2.0:1787848566.140312:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848566.140342:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631437440:0@lo:8:kworker.0 00000100:00100000:2.0:1787848566.140367:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848566.140402:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631437696 00000100:00100000:2.0:1787848566.140411:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631437696 00000100:00100000:2.0:1787848566.140495:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631437824 00000100:00100000:2.0:1787848566.140499:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631437824 00000100:00100000:2.0:1787848566.140516:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631437568 00000100:00100000:2.0:1787848566.140518:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631437568 00000100:00100000:2.0:1787848566.140535:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787848566.140545:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631437696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848566.140610:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631437696:12345-0@lo:400:kworker.0 Request processed in 66us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848566.140618:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787848566.143733:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631437312 00000100:00100000:0.0:1787848566.143752:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631437312 00000100:00100000:0.0:1787848566.143850:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631437440 00000100:00100000:0.0:1787848566.143855:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631437440 00000100:00100000:0.0:1787848566.143880:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787848566.143893:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631437312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848566.144296:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631437312:12345-0@lo:400:kworker.0 Request processed in 405us (4047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848566.144305:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787848566.144327:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787848566.144332:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874694631437440:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787848566.144364:0:15028:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1787848566.144402:0:15028:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aeb41e0543cc7e2 00002000:00100000:0.0:1787848566.144418:0:15028:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93fe413b3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113956 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787848566.144423:0:15028:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787848566.144438:0:15028:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787848566.146297:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631437312:0@lo:400:kworker.0 00000100:00080000:2.0:1787848566.146336:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787848566.146342:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848566.146362:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787848566.146375:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631437824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848566.146460:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79192940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631437824:12345-0@lo:400:kworker.0 Request processed in 80us (6261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848566.146467:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787848566.146486:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787848566.146493:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79193840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631437568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848566.146525:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79193840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631437568:12345-0@lo:400:kworker.0 Request processed in 33us (6213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848566.146543:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787848566.146573:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff79249680 x1874694631437568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848566.146585:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631437568:0@lo:400:kworker.0 00010000:00080000:2.0:1787848566.146613:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff79248b40 x1874694631437824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848566.146623:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79248b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631437824:0@lo:400:kworker.0 00010000:00080000:2.0:1787848566.146671:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff7924ad00 x1874694631437696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848566.146679:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631437696:0@lo:400:kworker.0 00000100:00100000:2.0:1787848566.146737:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631437184 00000100:00100000:2.0:1787848566.146743:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631437184 00000100:00100000:2.0:1787848566.146781:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787848566.146788:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3310:x1874694631437184:12345-0@lo:400:kworker.0 00002000:00080000:0.0:1787848566.148564:0:15028:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787848566.148609:0:15028:0:(import.c:65:import_set_state_nolock()) ffff93fe413b4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787848566.148757:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874694631437440:12345-0@lo:8:kworker.0 Request processed in 4421us (8386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848566.148770:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848566.152372:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3310:x1874694631437184:12345-0@lo:400:kworker.0 Request processed in 5570us (12217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848566.152394:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1787848566.154699:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff79249e00 x1874694631437440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787848591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787848566.154732:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787848566.154744:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787848566.154751:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787848566.154756:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93ff80247800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787848566.156077:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787848566.156097:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874694631437440:0@lo:8:kworker.0 00000004:00080000:2.0:1787848566.156199:0:14368:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787848566.156231:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14368:1874694631438080:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787848566.156316:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848566.156349:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f4d8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787848566.156364:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787848566.156374:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631437952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848566.156403:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848566.156433:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631437952 00000100:00100000:2.0:1787848566.156441:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631437952 00000100:00100000:2.0:1787848566.156508:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787848566.156520:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631437952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848566.156559:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848566.156610:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631437952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848566.156617:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787848566.159005:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631438080 00000100:00100000:1.0:1787848566.159023:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631438080 00000100:00100000:1.0:1787848566.159989:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787848566.160145:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14368:x1874694631438080:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1787848566.162919:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787848566.163031:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff791921c0 x1874694631437952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787848582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848566.163072:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631437952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848566.163126:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7924a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631437184:0@lo:400:kworker.0 00000004:00080000:2.0:1787848566.163187:0:14367:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787848566.166914:0:14367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 515078269135ns, next at 0ns, rc = 0 00002000:00080000:1.0:1787848566.193019:0:15028:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787848566.193034:0:15028:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787848566.193041:0:15028:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1787848566.234094:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.234107:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d492bbd5/0x9aeb41e0543cc7e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234126:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.234131:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.234138:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d492bbd5/0x9aeb41e0543cc7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234156:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d492bbd5/0x9aeb41e0543cc7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234175:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d492bbd5/0x9aeb41e0543cc7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234184:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d492bbd5/0x9aeb41e0543cc7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234205:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787848566.234218:0:15400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848566.234223:0:15400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d492bbd5/0x9aeb41e0543cc7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234230:0:15400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42fc00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.234234:0:15400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d492bbd5/0x9aeb41e0543cc7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234243:0:15400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d492bbd5/0x9aeb41e0543cc7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234260:0:15400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d492bbd5/0x9aeb41e0543cc7e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234267:0:15400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d492bbd5/0x9aeb41e0543cc7e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234287:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.234295:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.234297:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.234759:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.234766:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc7f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234776:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.234779:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.234784:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234794:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234803:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234810:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.234829:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787848566.235294:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.235304:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc7f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235312:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.235315:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.235319:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235337:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235345:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235352:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235374:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787848566.235389:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787848566.235394:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235402:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.235408:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235417:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235434:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc7f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235442:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb3855e6/0x9aeb41e0543cc7f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235469:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848566.235472:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235479:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.235482:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235489:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc7f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235499:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc7f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235505:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543cc7f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.235517:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.235519:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.235521:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.240255:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.250857:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.250871:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007806c97c/0x9aeb41e0543cc7fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.250888:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.250900:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.250907:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007806c97c/0x9aeb41e0543cc7fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.250921:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007806c97c/0x9aeb41e0543cc7fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.250930:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007806c97c/0x9aeb41e0543cc7fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.250937:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007806c97c/0x9aeb41e0543cc7fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.250962:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787848566.256616:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848566.256635:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007806c97c/0x9aeb41e0543cc7fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.256692:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e800 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848566.256699:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007806c97c/0x9aeb41e0543cc7fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.256712:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007806c97c/0x9aeb41e0543cc7fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.256749:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007806c97c/0x9aeb41e0543cc7fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.256758:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007806c97c/0x9aeb41e0543cc7fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.256794:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.256796:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.256798:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.259075:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.259089:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543cc805 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.259107:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.259111:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.259117:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543cc805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.259130:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543cc805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.259141:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543cc805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.259159:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543cc805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.259190:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787848566.261403:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.261415:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000052b7f76/0x9aeb41e0543cc80c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.261429:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.261434:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.261439:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000052b7f76/0x9aeb41e0543cc80c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.261452:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000052b7f76/0x9aeb41e0543cc80c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.261462:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000052b7f76/0x9aeb41e0543cc80c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.261469:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000052b7f76/0x9aeb41e0543cc80c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.262766:0:15400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848566.262795:0:15400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543cc805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.262811:0:15400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848566.262817:0:15400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543cc805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.262830:0:15400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543cc805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.262856:0:15400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543cc805 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.262865:0:15400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543cc805 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.262897:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.262899:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.262901:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.263466:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787848566.264170:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848566.264181:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000052b7f76/0x9aeb41e0543cc80c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.264193:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ee00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848566.264197:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000052b7f76/0x9aeb41e0543cc80c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.264225:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000052b7f76/0x9aeb41e0543cc80c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.264245:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000052b7f76/0x9aeb41e0543cc80c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.264252:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000052b7f76/0x9aeb41e0543cc80c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.264274:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.264276:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.264278:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.271702:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.271717:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc813 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.271742:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.271747:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.271753:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.271769:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.271779:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.271788:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.271815:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787848566.271834:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848566.271841:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.271848:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.271853:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.271862:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc813 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.271891:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc813 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.271899:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc813 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.271920:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.271922:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.271923:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.272349:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.272356:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc81a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.272364:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.272367:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.272372:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc81a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.272382:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc81a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.272391:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc81a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.272399:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc81a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.272426:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787848566.272435:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848566.272440:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc81a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.272448:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f200 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.272452:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc81a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.272460:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc81a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.272470:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc81a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.272477:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc81a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.272491:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.272493:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.272495:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.277914:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.277926:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cc821 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.277943:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.277954:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.277961:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cc821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.277977:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cc821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.277988:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cc821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.277995:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cc821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.278022:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787848566.278805:0:15400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848566.278819:0:15400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cc821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.278833:0:15400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42fa00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848566.278839:0:15400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cc821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.278851:0:15400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cc821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.278875:0:15400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cc821 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.278899:0:15400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce34c5cd/0x9aeb41e0543cc821 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.278929:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.278931:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.278934:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.284033:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.284046:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873e8b2a/0x9aeb41e0543cc828 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.284063:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.284068:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.284075:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000873e8b2a/0x9aeb41e0543cc828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.284091:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000873e8b2a/0x9aeb41e0543cc828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.284100:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873e8b2a/0x9aeb41e0543cc828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.284115:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000873e8b2a/0x9aeb41e0543cc828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.284150:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787848566.284164:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848566.284180:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000873e8b2a/0x9aeb41e0543cc828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.284195:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848566.284201:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000873e8b2a/0x9aeb41e0543cc828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.284214:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000873e8b2a/0x9aeb41e0543cc828 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.284244:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000873e8b2a/0x9aeb41e0543cc828 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.284253:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000873e8b2a/0x9aeb41e0543cc828 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.284280:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.284282:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.284284:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.287879:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.287890:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc82f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.287906:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.287911:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.287917:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc82f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.287930:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc82f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.287941:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc82f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.287949:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc82f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.287987:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787848566.288495:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.288501:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b11f7c7/0x9aeb41e0543cc836 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.288517:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.288520:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.288524:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b11f7c7/0x9aeb41e0543cc836 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.288534:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b11f7c7/0x9aeb41e0543cc836 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.288542:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b11f7c7/0x9aeb41e0543cc836 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.288550:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b11f7c7/0x9aeb41e0543cc836 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.288571:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787848566.289016:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.289023:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d33cb31/0x9aeb41e0543cc83d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.289030:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.289033:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.289037:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d33cb31/0x9aeb41e0543cc83d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.289047:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d33cb31/0x9aeb41e0543cc83d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.289067:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d33cb31/0x9aeb41e0543cc83d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.289074:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d33cb31/0x9aeb41e0543cc83d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.289087:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787848566.289495:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.289501:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543cc844 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.289509:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.289512:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.289516:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543cc844 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.289524:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543cc844 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.289532:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543cc844 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.289538:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543cc844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.289561:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787848566.290072:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.290078:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543cc84b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.290087:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.290090:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.290094:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543cc84b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.290103:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543cc84b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.290110:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543cc84b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.290116:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543cc84b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.290123:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787848566.290490:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.290496:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e020131/0x9aeb41e0543cc852 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.290503:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.290512:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.290517:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e020131/0x9aeb41e0543cc852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.290526:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e020131/0x9aeb41e0543cc852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.290534:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e020131/0x9aeb41e0543cc852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.290540:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e020131/0x9aeb41e0543cc852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.290548:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1787848566.291765:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787848566.291776:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc82f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291786:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ec00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848566.291791:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc82f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291802:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc82f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291824:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc82f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291832:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c266a3e4/0x9aeb41e0543cc82f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291869:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787848566.291874:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b11f7c7/0x9aeb41e0543cc836 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291881:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848566.291885:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b11f7c7/0x9aeb41e0543cc836 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291893:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b11f7c7/0x9aeb41e0543cc836 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291904:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b11f7c7/0x9aeb41e0543cc836 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291911:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b11f7c7/0x9aeb41e0543cc836 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291924:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787848566.291928:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d33cb31/0x9aeb41e0543cc83d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291935:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a4800 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848566.291938:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d33cb31/0x9aeb41e0543cc83d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291959:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d33cb31/0x9aeb41e0543cc83d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291970:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d33cb31/0x9aeb41e0543cc83d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291978:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d33cb31/0x9aeb41e0543cc83d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.291992:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787848566.292002:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543cc844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292009:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a4c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848566.292012:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543cc844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292020:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543cc844 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292031:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543cc844 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292039:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543cc844 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292064:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787848566.292068:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543cc84b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292075:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a4e00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848566.292078:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543cc84b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292086:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543cc84b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292096:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543cc84b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292103:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543cc84b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292115:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848566.292119:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e020131/0x9aeb41e0543cc852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292125:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848566.292128:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e020131/0x9aeb41e0543cc852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292147:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e020131/0x9aeb41e0543cc852 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292158:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e020131/0x9aeb41e0543cc852 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292166:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e020131/0x9aeb41e0543cc852 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.292179:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848566.292182:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848566.292183:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.292528:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.292542:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.292551:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.299857:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.299866:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad0c4a1c/0x9aeb41e0543cc859 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.299880:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.299883:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.299888:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad0c4a1c/0x9aeb41e0543cc859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.299898:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad0c4a1c/0x9aeb41e0543cc859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.299906:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad0c4a1c/0x9aeb41e0543cc859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.299915:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad0c4a1c/0x9aeb41e0543cc859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.299932:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787848566.300076:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787848566.300081:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad0c4a1c/0x9aeb41e0543cc859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.300087:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848566.300091:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad0c4a1c/0x9aeb41e0543cc859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.300097:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad0c4a1c/0x9aeb41e0543cc859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.300110:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad0c4a1c/0x9aeb41e0543cc859 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.300124:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad0c4a1c/0x9aeb41e0543cc859 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848566.300140:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848566.300141:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787848566.300142:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.302178:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.302187:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d63a795/0x9aeb41e0543cc860 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.302201:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.302207:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.302213:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d63a795/0x9aeb41e0543cc860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.302226:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d63a795/0x9aeb41e0543cc860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.302236:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d63a795/0x9aeb41e0543cc860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.302245:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d63a795/0x9aeb41e0543cc860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.302281:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787848566.302540:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848566.302553:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d63a795/0x9aeb41e0543cc860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.302567:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a4400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848566.302574:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d63a795/0x9aeb41e0543cc860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.302586:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d63a795/0x9aeb41e0543cc860 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.302614:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d63a795/0x9aeb41e0543cc860 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.302622:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d63a795/0x9aeb41e0543cc860 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.302689:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.302691:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.302696:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.304681:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.304694:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543cc867 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.304716:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.304721:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.304727:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543cc867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.304740:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543cc867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.304747:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543cc867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.304753:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543cc867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.304766:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787848566.305097:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.305101:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b78c7fbc/0x9aeb41e0543cc86e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.305106:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.305108:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.305111:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b78c7fbc/0x9aeb41e0543cc86e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.305117:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b78c7fbc/0x9aeb41e0543cc86e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.305130:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b78c7fbc/0x9aeb41e0543cc86e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.305134:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b78c7fbc/0x9aeb41e0543cc86e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.305144:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787848566.307059:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.307067:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7c185f0/0x9aeb41e0543cc875 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307078:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.307081:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.307084:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c185f0/0x9aeb41e0543cc875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307092:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7c185f0/0x9aeb41e0543cc875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307099:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7c185f0/0x9aeb41e0543cc875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307104:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c185f0/0x9aeb41e0543cc875 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307128:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787848566.307142:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787848566.307147:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543cc867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307152:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a4600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.307155:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543cc867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307161:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543cc867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307173:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543cc867 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307178:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543cc867 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307193:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787848566.307195:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b78c7fbc/0x9aeb41e0543cc86e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307199:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a4a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.307203:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b78c7fbc/0x9aeb41e0543cc86e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307222:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b78c7fbc/0x9aeb41e0543cc86e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307231:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b78c7fbc/0x9aeb41e0543cc86e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307239:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b78c7fbc/0x9aeb41e0543cc86e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307455:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848566.307459:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7c185f0/0x9aeb41e0543cc875 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307466:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5e00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.307469:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7c185f0/0x9aeb41e0543cc875 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307476:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7c185f0/0x9aeb41e0543cc875 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307487:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7c185f0/0x9aeb41e0543cc875 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307495:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7c185f0/0x9aeb41e0543cc875 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.307522:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.307523:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.307525:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787848566.308873:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.308883:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000446c21ad/0x9aeb41e0543cc87c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.308898:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.308903:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.308909:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000446c21ad/0x9aeb41e0543cc87c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.308921:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000446c21ad/0x9aeb41e0543cc87c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.308932:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000446c21ad/0x9aeb41e0543cc87c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.308941:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000446c21ad/0x9aeb41e0543cc87c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.308963:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787848566.309667:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.309674:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc883 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309692:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.309695:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.309699:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc883 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309708:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc883 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309716:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc883 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309723:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309738:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787848566.309748:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787848566.309753:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000446c21ad/0x9aeb41e0543cc87c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309760:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.309764:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000446c21ad/0x9aeb41e0543cc87c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309771:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000446c21ad/0x9aeb41e0543cc87c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309795:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000446c21ad/0x9aeb41e0543cc87c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309803:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000446c21ad/0x9aeb41e0543cc87c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309823:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848566.309826:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309834:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f200 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.309838:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309847:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc883 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309858:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc883 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309866:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9b6180/0x9aeb41e0543cc883 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.309881:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.309882:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.309891:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.309892:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.309911:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.309922:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787848566.310670:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787848566.310991:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787848566.310999:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc88a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.311011:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1787848566.311015:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848566.311020:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc88a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.311032:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc88a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.311042:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc88a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.311050:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc88a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.311072:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787848566.311128:0:15400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848566.311139:0:15400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc88a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.311166:0:15400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f600 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848566.311172:0:15400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc88a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.311184:0:15400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc88a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.311209:0:15400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc88a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.311217:0:15400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025f38f76/0x9aeb41e0543cc88a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.311243:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.311245:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848566.311247:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848566.313366:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848566.313379:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9c59159/0x9aeb41e0543cc891 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.313398:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1787848566.313403:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848566.313410:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9c59159/0x9aeb41e0543cc891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.313422:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9c59159/0x9aeb41e0543cc891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.313441:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9c59159/0x9aeb41e0543cc891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.313515:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9c59159/0x9aeb41e0543cc891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.313549:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787848566.314197:0:15402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848566.314208:0:15402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9c59159/0x9aeb41e0543cc891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.314218:0:15402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b57200 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.314223:0:15402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9c59159/0x9aeb41e0543cc891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.314248:0:15402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9c59159/0x9aeb41e0543cc891 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.314269:0:15402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9c59159/0x9aeb41e0543cc891 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.314276:0:15402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9c59159/0x9aeb41e0543cc891 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.314294:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.314296:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.314297:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848566.315296:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848566.315307:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094d9518f/0x9aeb41e0543cc898 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.315327:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1787848566.315331:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848566.315338:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094d9518f/0x9aeb41e0543cc898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.315350:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094d9518f/0x9aeb41e0543cc898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.315360:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094d9518f/0x9aeb41e0543cc898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.315367:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094d9518f/0x9aeb41e0543cc898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.315410:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787848566.315536:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848566.315544:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094d9518f/0x9aeb41e0543cc898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.315553:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b56a00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.315557:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094d9518f/0x9aeb41e0543cc898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.315566:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094d9518f/0x9aeb41e0543cc898 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.315582:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094d9518f/0x9aeb41e0543cc898 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.315601:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094d9518f/0x9aeb41e0543cc898 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.315622:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.315625:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.315627:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787848566.316618:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787848566.316627:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712bf610/0x9aeb41e0543cc89f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.316684:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1787848566.316690:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848566.316696:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712bf610/0x9aeb41e0543cc89f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.316708:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712bf610/0x9aeb41e0543cc89f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.316718:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712bf610/0x9aeb41e0543cc89f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.316726:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712bf610/0x9aeb41e0543cc89f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848566.320614:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787848566.321267:0:15028:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1787848566.321402:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14368:x1874694631438080:12345-0@lo:5:osp-pre-1-0.0 Request processed in 161258us (165078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848566.321416:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787848566.326034:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14368:1874694631438080:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787848566.326098:0:14368:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787848566.326167:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14368:1874694631438208:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787848566.326247:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848566.326318:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff483dc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787848566.327846:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631438208 00000100:00100000:3.0:1787848566.327862:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631438208 00000100:00100000:3.0:1787848566.327933:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787848566.327946:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14368:x1874694631438208:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787848566.328005:0:15029:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1787848566.337767:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787848566.337786:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712bf610/0x9aeb41e0543cc89f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.337813:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b56000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848566.337818:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712bf610/0x9aeb41e0543cc89f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.337832:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712bf610/0x9aeb41e0543cc89f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.337862:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712bf610/0x9aeb41e0543cc89f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.337871:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712bf610/0x9aeb41e0543cc89f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848566.337911:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.337916:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848566.337919:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848566.349070:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14368:x1874694631438208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 21120us (22816us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787848566.349084:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787848566.349234:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14368:1874694631438208:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787848566.349259:0:14368:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000040:00080000:1.0:1787848566.385761:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787848566.963682:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848567.983890:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848569.008267:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848569.711972:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787848569.712019:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631438336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787848569.712129:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848569.712232:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631438336 00000100:00100000:2.0:1787848569.712242:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631438336 00000100:00100000:2.0:1787848569.712316:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787848569.712327:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631438336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848569.712379:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848569.712438:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631438336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848569.712448:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787848569.712478:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848569.712529:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631438336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787848570.032900:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787848570.330990:0:16101:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787848571.056265:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848571.251619:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787848571.251669:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631438464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848571.251804:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848571.255696:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631438720:0@lo:400:kworker.0 00000100:00100000:0.0:1787848571.255771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848571.255811:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787848571.255818:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631438848:0@lo:400:kworker.0 00000100:00100000:0.0:1787848571.255844:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848571.258766:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631438720 00000100:00100000:0.0:1787848571.258782:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631438720 00000100:00100000:0.0:1787848571.258854:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787848571.259688:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631438720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848571.259793:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631438720:12345-0@lo:400:kworker.0 Request processed in 918us (4021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848571.259801:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787848571.259834:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631438848 00000100:00100000:0.0:1787848571.259838:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631438848 00000100:00100000:0.0:1787848571.267704:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787848571.267728:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631438848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848571.267832:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631438848:12345-0@lo:400:kworker.0 Request processed in 114us (11986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848571.267841:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787848571.269608:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631438976:0@lo:400:kworker.0 00000100:00100000:2.0:1787848571.269693:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848571.269736:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787848571.269744:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631438592:0@lo:400:kworker.0 00000100:00100000:2.0:1787848571.269775:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848571.269822:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631439104:0@lo:400:kworker.0 00000100:00100000:2.0:1787848571.269850:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848571.269896:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631438464 00000100:00100000:2.0:1787848571.269904:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631438464 00000100:00100000:2.0:1787848571.269958:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787848571.269968:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874694631438464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848571.270012:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848571.270052:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874694631438464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (18249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848571.270059:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787848571.270079:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631438976 00000100:00100000:2.0:1787848571.270083:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631438976 00000100:00080000:0.0:1787848571.272725:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787848571.272735:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787848571.272738:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787848571.272790:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e21c0 x1874694631438848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787848571.272806:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631438848:0@lo:400:kworker.0 00000100:00100000:0.0:1787848571.272827:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631438720:0@lo:400:kworker.0 00000100:00100000:1.0:1787848571.273939:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631438464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848571.277956:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631439104 00000100:00100000:2.0:1787848571.277970:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631439104 00000100:00100000:0.0:1787848571.281265:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787848571.281295:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631438976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848571.281697:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874694631438976:12345-0@lo:400:kworker.0 Request processed in 407us (12002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848571.281706:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787848571.281730:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787848571.281737:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff792492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631439104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848571.281769:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff792492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631439104:12345-0@lo:400:kworker.0 Request processed in 33us (11917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848571.281774:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787848571.282233:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631438592 00000100:00100000:2.0:1787848571.282242:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631438592 00000100:00100000:2.0:1787848571.282290:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787848571.282298:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3310:x1874694631438592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848571.282345:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3310:x1874694631438592:12345-0@lo:400:kworker.0 Request processed in 40us (12561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848571.282352:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1787848571.282691:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848571.282837:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631438592:0@lo:400:kworker.0 00010000:00080000:2.0:1787848571.282855:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e2d00 x1874694631439104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848571.283013:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631439104:0@lo:400:kworker.0 00010000:00080000:2.0:1787848571.283029:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ff807e2580 x1874694631438976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787848587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787848571.283050:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874694631438976:0@lo:400:kworker.0 00000001:00100000:1.0:1787848571.497262:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787848571.497324:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1787848572.079794:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848573.112553:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848574.053867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848574.054000:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611511808 00000100:00100000:2.0:1787848574.054011:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611511808 00000100:00100000:2.0:1787848574.054056:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 78 00000100:00100000:2.0:1787848574.054064:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1874694611511808:12345-192.168.201.26@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787848574.054095:0:14337:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 54655a3a-d2df-4afc-9081-6ffd334ecd56@192.168.201.26@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:2.0:1787848574.054300:0:14337:0:(genops.c:1385:class_connect()) connect: client 54655a3a-d2df-4afc-9081-6ffd334ecd56, cookie 0x9aeb41e0543cc8a6 00000100:00080000:2.0:1787848574.054542:0:14337:0:(import.c:65:import_set_state_nolock()) ffff93ff7fa7f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787848574.054622:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+5:2350:x1874694611511808:12345-192.168.201.26@tcp:250:mount.lustre.0 Request processed in 557us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848574.054631:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 78 00000100:00100000:1.0:1787848574.075178:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848574.075345:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611511936 00000100:00100000:3.0:1787848574.075357:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611511936 00000100:00100000:3.0:1787848574.075427:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:3.0:1787848574.075438:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+5:13759:x1874694611511936:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787848574.075455:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848574.075473:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc8ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb5ae expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.075530:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5ae expref: 6 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.075542:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79237200/0x9aeb41e0543cc8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5ae expref: 6 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.075552:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237200, rc 0) 00000100:00100000:3.0:1787848574.075664:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+6:13759:x1874694611511936:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 204us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848574.075672:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:1.0:1787848574.093029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848574.093583:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611512064 00000100:00100000:3.0:1787848574.093594:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611512064 00000100:00100000:3.0:1787848574.093682:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:3.0:1787848574.093694:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+6:13759:x1874694611512064:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787848574.093987:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+6:13759:x1874694611512064:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 294us (968us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787848574.093995:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:1.0:1787848574.100611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848574.100749:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611512192 00000100:00100000:0.0:1787848574.100759:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611512192 00000100:00100000:0.0:1787848574.100811:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 81 00000100:00100000:0.0:1787848574.100822:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+6:13759:x1874694611512192:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787848574.100844:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848574.100864:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93fe41b57600/0x9aeb41e0543cc8b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb5b5 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848574.100893:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93fe41b57600/0x9aeb41e0543cc8b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5b5 expref: 7 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848574.100905:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93fe41b57600/0x9aeb41e0543cc8b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5b5 expref: 7 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848574.100932:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b57600, rc 0) 00000100:00100000:0.0:1787848574.100996:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+7:13759:x1874694611512192:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 176us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848574.101005:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 81 00000100:00100000:1.0:1787848574.108324:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848574.108675:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611512320 00000100:00100000:0.0:1787848574.108689:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611512320 00000100:00100000:0.0:1787848574.108750:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:0.0:1787848574.108761:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+7:13759:x1874694611512320:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787848574.109076:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+8:13759:x1874694611512320:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 315us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848574.109085:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:1.0:1787848574.121353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848574.121486:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611512448 00000100:00100000:3.0:1787848574.121497:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611512448 00000100:00100000:3.0:1787848574.121599:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 83 00000100:00100000:3.0:1787848574.121609:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff4479d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+8:13759:x1874694611512448:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787848574.121890:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff4479d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+8:13759:x1874694611512448:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 280us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848574.121898:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 83 00010000:00010000:1.0:1787848574.127815:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848574.129939:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848574.130051:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611512576 00000100:00100000:2.0:1787848574.130061:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611512576 00000100:00100000:2.0:1787848574.130112:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 84 00000100:00100000:2.0:1787848574.130122:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+8:13777:x1874694611512576:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787848574.130456:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+8:13777:x1874694611512576:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 334us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848574.130464:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 84 00000100:00100000:1.0:1787848574.183748:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848574.184870:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611512704 00000100:00100000:0.0:1787848574.184890:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611512704 00000100:00100000:0.0:1787848574.185101:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 85 00000100:00100000:0.0:1787848574.185284:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+8:13777:x1874694611512704:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787848574.188404:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+8:13777:x1874694611512704:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 3112us (4655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848574.188424:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 85 00000100:00100000:1.0:1787848574.197276:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848574.207281:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611512832 00000100:00100000:3.0:1787848574.207326:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611512832 00000100:00100000:3.0:1787848574.207419:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:3.0:1787848574.207433:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+8:13759:x1874694611512832:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787848574.207459:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848574.207485:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79236a00/0x9aeb41e0543cc8bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb5df expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.207539:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79236a00/0x9aeb41e0543cc8bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5df expref: 9 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.207553:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79236a00/0x9aeb41e0543cc8bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5df expref: 9 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.207564:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236a00, rc 0) 00000100:00100000:3.0:1787848574.207714:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+9:13759:x1874694611512832:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 283us (10454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848574.207721:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:1.0:1787848574.228204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848574.228618:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611512960 00000100:00100000:0.0:1787848574.228633:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611512960 00000100:00100000:0.0:1787848574.228757:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00100000:0.0:1787848574.228771:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+9:13759:x1874694611512960:12345-192.168.201.26@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787848574.228819:0:14336:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787848574.228861:0:14336:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787848574.228872:0:14336:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787848574.228876:0:14336:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787848574.228878:0:14336:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787848574.236164:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+9:13759:x1874694611512960:12345-192.168.201.26@tcp:256:mount.lustre.0 Request processed in 7378us (7958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848574.236183:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00100000:1.0:1787848574.245741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848574.246138:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611513088 00000100:00100000:3.0:1787848574.246154:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611513088 00000100:00100000:3.0:1787848574.246227:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 88 00000100:00100000:3.0:1787848574.246237:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+9:13759:x1874694611513088:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787848574.246258:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848574.246285:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79236800/0x9aeb41e0543cc8c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb5e6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.246321:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79236800/0x9aeb41e0543cc8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5e6 expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.246334:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79236800/0x9aeb41e0543cc8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5e6 expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.246362:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79236800, rc 0) 00000100:00100000:3.0:1787848574.246447:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+10:13759:x1874694611513088:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 211us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848574.246454:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 88 00000100:00100000:1.0:1787848574.251062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848574.254423:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611513216 00000100:00100000:0.0:1787848574.254442:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611513216 00000100:00100000:0.0:1787848574.254543:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 89 00000100:00100000:0.0:1787848574.254557:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+10:13759:x1874694611513216:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787848574.255017:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+10:13759:x1874694611513216:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 461us (3969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848574.255026:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 89 00000100:00100000:1.0:1787848574.262351:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848574.262449:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611513344 00000100:00100000:3.0:1787848574.262463:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611513344 00000100:00100000:3.0:1787848574.262545:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 90 00000100:00100000:3.0:1787848574.262558:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+10:13759:x1874694611513344:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787848574.263366:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+10:13759:x1874694611513344:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 806us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848574.263376:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 90 00000100:00100000:1.0:1787848574.269463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848574.269599:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611513472 00000100:00100000:0.0:1787848574.269613:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611513472 00000100:00100000:0.0:1787848574.269732:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:0.0:1787848574.269743:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+10:13783:x1874694611513472:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787848574.270446:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+10:13783:x1874694611513472:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 700us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848574.270458:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:3.0:1787848574.289375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848574.289609:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611513600 00000100:00100000:2.0:1787848574.289630:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611513600 00000100:00100000:2.0:1787848574.289815:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00100000:2.0:1787848574.289828:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+10:13783:x1874694611513600:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787848574.290113:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+10:13783:x1874694611513600:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 287us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848574.290133:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00100000:0.0:1787848574.295126:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848574.295279:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611513728 00000100:00100000:3.0:1787848574.295289:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611513728 00000100:00100000:3.0:1787848574.295351:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:3.0:1787848574.295361:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1874694611513728:12345-192.168.201.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787848574.295395:0:14344:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 529328da-5578-45e5-bbcb-fef88c94f123@192.168.201.26@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:3.0:1787848574.295459:0:14344:0:(genops.c:1385:class_connect()) connect: client 529328da-5578-45e5-bbcb-fef88c94f123, cookie 0x9aeb41e0543cc8c9 00000004:00100000:3.0:1787848574.295491:0:14344:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787848574.295498:0:14344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787848574.352044:0:14344:0:(import.c:65:import_set_state_nolock()) ffff93ff5f355000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787848574.352270:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+6:2350:x1874694611513728:12345-192.168.201.26@tcp:38:mount.lustre.0 Request processed in 56907us (57152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848574.352283:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:0.0:1787848574.369737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848574.369857:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848574.370148:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611513984 00000100:00100000:2.0:1787848574.370159:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611513984 00000100:00100000:2.0:1787848574.370281:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611513856 00000100:00100000:2.0:1787848574.370285:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611513856 00000100:00100000:2.0:1787848574.370310:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:2.0:1787848574.370319:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+7:13759:x1874694611513984:12345-192.168.201.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787848574.370374:0:14343:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787848574.370464:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+7:13759:x1874694611513984:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 146us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848574.370473:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:2.0:1787848574.370491:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:2.0:1787848574.370499:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+6:0:x1874694611513856:12345-192.168.201.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787848574.370511:0:14343:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787848574.370546:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+6:0:x1874694611513856:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 48us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848574.370552:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00080000:0.0:1787848574.377699:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848574.385329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848574.385484:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611514112 00000100:00100000:2.0:1787848574.385494:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611514112 00000100:00100000:2.0:1787848574.385563:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:2.0:1787848574.385573:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+6:13759:x1874694611514112:12345-192.168.201.26@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787848574.385685:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+6:13759:x1874694611514112:12345-192.168.201.26@tcp:40:mount.lustre.0 Request processed in 113us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848574.385693:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:1.0:1787848574.390970:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848574.391053:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848574.391365:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611514496 00000100:00100000:0.0:1787848574.391376:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611514496 00000100:00100000:0.0:1787848574.391434:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:0.0:1787848574.391443:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79195a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:529328da-5578-45e5-bbcb-fef88c94f123+6:13759:x1874694611514496:12345-192.168.201.26@tcp:33:mount.lustre.0 00000100:00100000:3.0:1787848574.391812:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611514240 00000100:00100000:3.0:1787848574.391818:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611514240 00000100:00100000:3.0:1787848574.391862:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:3.0:1787848574.391868:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79197c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874694611514240:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787848574.391893:0:15029:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 529328da-5578-45e5-bbcb-fef88c94f123@192.168.201.26@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:3.0:1787848574.391921:0:15029:0:(genops.c:1385:class_connect()) connect: client 529328da-5578-45e5-bbcb-fef88c94f123, cookie 0x9aeb41e0543cc8d0 00002000:00100000:3.0:1787848574.391933:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 529328da-5578-45e5-bbcb-fef88c94f123/ffff93ff5f351800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787848574.391956:0:15029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787848574.392490:0:15029:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787848574.392531:0:15029:0:(import.c:65:import_set_state_nolock()) ffff93ff5f357800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787848574.392668:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79197c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:529328da-5578-45e5-bbcb-fef88c94f123+6:2350:x1874694611514240:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 768us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848574.392678:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000004:00080000:2.0:1787848574.400973:0:14346:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9468us 00000100:00100000:1.0:1787848574.405440:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848574.405927:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611514368 00000100:00100000:2.0:1787848574.405939:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611514368 00000100:00100000:2.0:1787848574.405992:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:2.0:1787848574.406001:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1874694611514368:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787848574.406037:0:15026:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 529328da-5578-45e5-bbcb-fef88c94f123@192.168.201.26@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1787848574.406084:0:15026:0:(genops.c:1385:class_connect()) connect: client 529328da-5578-45e5-bbcb-fef88c94f123, cookie 0x9aeb41e0543cc8d7 00002000:00100000:2.0:1787848574.406096:0:15026:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 529328da-5578-45e5-bbcb-fef88c94f123/ffff93ff7fa79800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787848574.406121:0:15026:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787848574.406463:0:15026:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787848574.406498:0:15026:0:(import.c:65:import_set_state_nolock()) ffff93ff80205000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787848574.406587:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:529328da-5578-45e5-bbcb-fef88c94f123+6:2350:x1874694611514368:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 585us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848574.406595:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000004:00200000:3.0:1787848574.423270:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787848574.423481:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79195a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:529328da-5578-45e5-bbcb-fef88c94f123+6:13759:x1874694611514496:12345-192.168.201.26@tcp:33:mount.lustre.0 Request processed in 32033us (32514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848574.423499:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:1.0:1787848574.757306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848574.757631:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611514624 00000100:00100000:3.0:1787848574.757666:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611514624 00000100:00100000:3.0:1787848574.757733:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:3.0:1787848574.757743:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79195680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+6:13804:x1874694611514624:12345-192.168.201.26@tcp:101:mkdir.0 00010000:00010000:3.0:1787848574.757762:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848574.757789:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237600/0x9aeb41e0543cc8de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb610 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.757883:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc8e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.757914:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.757929:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848574.758218:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787848574.758222:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848574.758319:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.758348:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237600/0x9aeb41e0543cc8de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb610 expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.758366:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb610 expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848574.758376:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1d00) 00010000:00010000:3.0:1787848574.758380:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787848574.758383:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237c00, rc 0) 00000100:00100000:3.0:1787848574.758480:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79195680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+7:13804:x1874694611514624:12345-192.168.201.26@tcp:101:mkdir.0 Request processed in 738us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848574.758488:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:3.0:1787848574.833459:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787848574.833488:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631439232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848574.833585:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848574.833763:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631439232 00000100:00100000:2.0:1787848574.833773:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631439232 00000100:00100000:2.0:1787848574.833855:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848574.833867:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631439232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848574.833895:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848574.833949:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631439232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848574.833957:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787848574.834008:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631439232:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787848574.834990:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787848575.152670:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787848576.176689:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848576.368662:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79195e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631439488:0@lo:400:kworker.0 00000100:00100000:1.0:1787848576.368737:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848576.368792:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631440000:0@lo:400:kworker.0 00000100:00100000:1.0:1787848576.368822:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848576.368846:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787848576.368852:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631439616:0@lo:400:kworker.0 00000100:00100000:1.0:1787848576.368873:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848576.368977:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631439744:0@lo:400:kworker.0 00000100:00100000:1.0:1787848576.369000:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848576.370566:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787848576.370580:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631439360:0@lo:400:kworker.0 00000100:00100000:1.0:1787848576.370629:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848576.370674:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631439872:0@lo:400:kworker.0 00000100:00100000:1.0:1787848576.370698:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848576.370732:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631440000 00000100:00100000:1.0:1787848576.370739:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631440000 00000100:00100000:1.0:1787848576.370787:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631439744 00000100:00100000:1.0:1787848576.370791:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631439744 00000100:00100000:1.0:1787848576.370804:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631439872 00000100:00100000:1.0:1787848576.370806:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631439872 00000100:00100000:1.0:1787848576.370822:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787848576.370830:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631440000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848576.370881:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631440000:12345-0@lo:400:kworker.0 Request processed in 52us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848576.370899:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787848576.370919:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787848576.370926:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631439744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848576.370958:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631439744:12345-0@lo:400:kworker.0 Request processed in 33us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848576.370964:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787848576.370977:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787848576.370983:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631439872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848576.371302:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631439488 00000100:00100000:3.0:1787848576.371306:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631439488 00000100:00100000:3.0:1787848576.371343:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631439616 00000100:00100000:3.0:1787848576.371348:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631439616 00000100:00100000:3.0:1787848576.371366:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787848576.371373:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631439488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848576.371408:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631439488:12345-0@lo:400:kworker.0 Request processed in 36us (2671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848576.371414:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787848576.371427:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787848576.371433:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631439616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848576.371461:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631439616:12345-0@lo:400:kworker.0 Request processed in 29us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848576.371467:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787848576.371521:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff7fd5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631440128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848576.371551:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848576.371610:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631439360 00000100:00100000:3.0:1787848576.371614:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631439360 00000100:00100000:3.0:1787848576.371661:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787848576.371668:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3312:x1874694631439360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848576.371702:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3312:x1874694631439360:12345-0@lo:400:kworker.0 Request processed in 35us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848576.371708:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1787848576.371735:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848576.371740:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848576.371742:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848576.371767:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787848576.371785:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631439616:0@lo:400:kworker.0 00000100:00100000:3.0:1787848576.371799:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79195e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631439488:0@lo:400:kworker.0 00000100:00100000:3.0:1787848576.371827:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631440000:0@lo:400:kworker.0 00000100:00100000:3.0:1787848576.371933:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631439360:0@lo:400:kworker.0 00000100:00100000:3.0:1787848576.371945:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631439872:0@lo:400:kworker.0 00000100:00100000:3.0:1787848576.371956:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631439744:0@lo:400:kworker.0 00000100:00100000:2.0:1787848576.374070:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631440128 00000100:00100000:2.0:1787848576.374087:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631440128 00000100:00100000:2.0:1787848576.374184:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787848576.374194:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631440128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787848576.374229:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787848576.374319:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631440128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (2766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848576.374327:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787848576.374380:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff7fd5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631440128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848576.376863:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631439872:12345-0@lo:400:kworker.0 Request processed in 5871us (6154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848576.376884:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000001:00100000:0.0:1787848576.482691:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 529328da-5578-45e5-bbcb-fef88c94f123 00000040:00080000:2.0:1787848576.624443:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787848577.203081:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848577.304910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848577.305038:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611514752 00000100:00100000:0.0:1787848577.305050:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611514752 00000100:00100000:0.0:1787848577.305155:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:0.0:1787848577.305167:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+7:13856:x1874694611514752:12345-192.168.201.26@tcp:41:lfs.0 00000004:00000024:0.0:1787848577.305215:0:14344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787848577.305315:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+7:13856:x1874694611514752:12345-192.168.201.26@tcp:41:lfs.0 Request processed in 151us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848577.305323:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00080000:3.0:1787848577.305684:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848577.313992:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848577.315083:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611514880 00000100:00100000:0.0:1787848577.315098:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611514880 00000100:00100000:0.0:1787848577.315257:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:0.0:1787848577.315268:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:529328da-5578-45e5-bbcb-fef88c94f123+6:13856:x1874694611514880:12345-192.168.201.26@tcp:13:lfs.0 00002000:00000024:0.0:1787848577.315309:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848577.315409:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:529328da-5578-45e5-bbcb-fef88c94f123+6:13856:x1874694611514880:12345-192.168.201.26@tcp:13:lfs.0 Request processed in 143us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848577.315417:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00080000:3.0:1787848577.318325:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848577.318951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848577.319117:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611515008 00000100:00100000:1.0:1787848577.319126:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611515008 00000100:00100000:1.0:1787848577.319189:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:1.0:1787848577.319200:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:529328da-5578-45e5-bbcb-fef88c94f123+5:13856:x1874694611515008:12345-192.168.201.26@tcp:13:lfs.0 00002000:00000024:1.0:1787848577.319225:0:15031:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848577.319315:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:529328da-5578-45e5-bbcb-fef88c94f123+5:13856:x1874694611515008:12345-192.168.201.26@tcp:13:lfs.0 Request processed in 116us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848577.319323:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00080000:3.0:1787848577.324476:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1787848577.439676:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 529328da-5578-45e5-bbcb-fef88c94f123 00000100:00100000:2.0:1787848577.562519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848577.571563:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611515136 00000100:00100000:3.0:1787848577.571587:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611515136 00000100:00100000:0.0:1787848577.572031:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:0.0:1787848577.572063:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+10:13889:x1874694611515136:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787848577.572089:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848577.572110:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93fe41b56400/0x9aeb41e0543cc8ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb617 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848577.572144:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93fe41b56400/0x9aeb41e0543cc8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb617 expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848577.572186:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93fe41b56400/0x9aeb41e0543cc8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb617 expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848577.572195:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b56400, rc 0) 00000100:00100000:0.0:1787848577.572284:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:13889:x1874694611515136:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 241us (9783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848577.572292:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:2.0:1787848577.596387:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848577.598596:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611515264 00000100:00100000:3.0:1787848577.598619:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611515264 00000100:00100000:3.0:1787848577.598874:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 95 00000100:00100000:3.0:1787848577.598887:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:13889:x1874694611515264:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787848577.599525:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:13889:x1874694611515264:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 636us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848577.599537:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 95 00000100:00100000:1.0:1787848577.608697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848577.611215:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611515392 00000100:00100000:0.0:1787848577.611235:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611515392 00000100:00100000:0.0:1787848577.611337:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:0.0:1787848577.611350:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:13889:x1874694611515392:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787848577.612028:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:13889:x1874694611515392:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 666us (3325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848577.612057:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:0.0:1787848577.615412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848577.615697:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611515520 00000100:00100000:3.0:1787848577.615712:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611515520 00000100:00100000:3.0:1787848577.615924:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00100000:3.0:1787848577.615937:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff602f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:13895:x1874694611515520:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787848577.616747:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff602f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:13895:x1874694611515520:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 807us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848577.616758:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00100000:3.0:1787848577.631467:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848577.631680:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611515648 00000100:00100000:1.0:1787848577.631712:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611515648 00000100:00100000:1.0:1787848577.631795:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 98 00000100:00100000:1.0:1787848577.631806:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:13895:x1874694611515648:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787848577.632179:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:13895:x1874694611515648:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 373us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848577.632189:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 98 00000100:00100000:1.0:1787848577.639024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848577.640919:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611515776 00000100:00100000:2.0:1787848577.640937:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611515776 00000100:00100000:3.0:1787848577.642024:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:3.0:1787848577.642041:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:13889:x1874694611515776:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787848577.642063:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848577.642088:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff79237600/0x9aeb41e0543cc8f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb641 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848577.642132:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff79237600/0x9aeb41e0543cc8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb641 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848577.642145:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff79237600/0x9aeb41e0543cc8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb641 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848577.642156:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237600, rc 0) 00000100:00100000:3.0:1787848577.642262:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+12:13889:x1874694611515776:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 224us (3252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848577.642270:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:0.0:1787848577.659610:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848577.660178:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611515904 00000100:00100000:3.0:1787848577.660192:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611515904 00000100:00100000:3.0:1787848577.660272:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00100000:3.0:1787848577.660287:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+12:13889:x1874694611515904:12345-192.168.201.26@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787848577.660338:0:14336:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787848577.660381:0:14336:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787848577.660386:0:14336:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787848577.660389:0:14336:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787848577.660391:0:14336:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787848577.663007:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+12:13889:x1874694611515904:12345-192.168.201.26@tcp:256:mount.lustre.0 Request processed in 2710us (3398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848577.663040:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00100000:1.0:1787848577.666480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848577.666896:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611516032 00000100:00100000:2.0:1787848577.666909:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611516032 00000100:00100000:2.0:1787848577.667027:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 101 00000100:00100000:2.0:1787848577.667040:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+12:13889:x1874694611516032:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787848577.667065:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848577.667091:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50664c00/0x9aeb41e0543cc8fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb648 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848577.667129:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50664c00/0x9aeb41e0543cc8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb648 expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848577.667142:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50664c00/0x9aeb41e0543cc8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb648 expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848577.667177:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664c00, rc 0) 00000100:00100000:2.0:1787848577.667259:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13889:x1874694611516032:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 221us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848577.667268:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 101 00000100:00100000:0.0:1787848577.669604:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848577.669711:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611516160 00000100:00100000:3.0:1787848577.669724:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611516160 00000100:00100000:3.0:1787848577.669801:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00100000:3.0:1787848577.669812:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff444b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13889:x1874694611516160:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787848577.670232:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff444b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13889:x1874694611516160:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 419us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848577.670243:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00100000:3.0:1787848577.672959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848577.673134:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611516288 00000100:00100000:2.0:1787848577.673148:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611516288 00000100:00100000:2.0:1787848577.673258:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00100000:2.0:1787848577.673270:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff42b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13889:x1874694611516288:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787848577.674217:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff42b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13889:x1874694611516288:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 944us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848577.674228:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00100000:1.0:1787848577.682318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848577.682514:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611516416 00000100:00100000:0.0:1787848577.682527:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611516416 00000100:00100000:0.0:1787848577.682601:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00100000:0.0:1787848577.682614:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff42b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13899:x1874694611516416:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787848577.684252:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff42b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13899:x1874694611516416:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 1630us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848577.684266:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00100000:0.0:1787848577.694695:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848577.694914:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611516544 00000100:00100000:2.0:1787848577.694927:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611516544 00000100:00100000:2.0:1787848577.695008:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 105 00000100:00100000:2.0:1787848577.695020:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff42b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13899:x1874694611516544:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787848577.695352:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff42b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13899:x1874694611516544:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 333us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848577.695362:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 105 00000100:00100000:3.0:1787848577.700999:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848577.701300:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611516672 00000100:00100000:2.0:1787848577.701315:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611516672 00000100:00100000:2.0:1787848577.701380:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:2.0:1787848577.701390:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1874694611516672:12345-192.168.201.26@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787848577.701517:0:14343:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from c6b00587-f481-427a-8e8d-8f0f46610c6c@192.168.201.26@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1787848577.701565:0:14343:0:(genops.c:1385:class_connect()) connect: client c6b00587-f481-427a-8e8d-8f0f46610c6c, cookie 0x9aeb41e0543cc901 00000004:00100000:2.0:1787848577.701628:0:14343:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787848577.701866:0:14343:0:(import.c:65:import_set_state_nolock()) ffff93ff4806d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787848577.701952:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:2350:x1874694611516672:12345-192.168.201.26@tcp:38:mount.lustre.0 Request processed in 561us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848577.701961:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:1.0:1787848577.710956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848577.711005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848577.711116:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611516928 00000100:00100000:0.0:1787848577.711130:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611516928 00000100:00100000:0.0:1787848577.711224:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611516800 00000100:00100000:0.0:1787848577.711228:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611516800 00000100:00100000:0.0:1787848577.711258:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787848577.711269:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+7:13889:x1874694611516928:12345-192.168.201.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787848577.711334:0:14344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787848577.711447:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+7:13889:x1874694611516928:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 179us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848577.711464:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787848577.711486:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:0.0:1787848577.711493:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:0:x1874694611516800:12345-192.168.201.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787848577.711505:0:14344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787848577.711527:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:0:x1874694611516800:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 34us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848577.711534:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00080000:1.0:1787848577.712194:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848577.715893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848577.715970:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611517056 00000100:00100000:3.0:1787848577.715983:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611517056 00000100:00100000:3.0:1787848577.716057:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:3.0:1787848577.716069:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:13889:x1874694611517056:12345-192.168.201.26@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787848577.716182:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:13889:x1874694611517056:12345-192.168.201.26@tcp:40:mount.lustre.0 Request processed in 115us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848577.716191:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:0.0:1787848577.720131:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848577.720248:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611517184 00000100:00100000:3.0:1787848577.720261:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611517184 00000100:00100000:3.0:1787848577.720316:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:3.0:1787848577.720327:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874694611517184:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787848577.720371:0:15029:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from c6b00587-f481-427a-8e8d-8f0f46610c6c@192.168.201.26@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:3.0:1787848577.720431:0:15029:0:(genops.c:1385:class_connect()) connect: client c6b00587-f481-427a-8e8d-8f0f46610c6c, cookie 0x9aeb41e0543cc908 00002000:00100000:3.0:1787848577.720449:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c6b00587-f481-427a-8e8d-8f0f46610c6c/ffff93ff606de000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787848577.720496:0:15029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787848577.720871:0:15029:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787848577.720907:0:15029:0:(import.c:65:import_set_state_nolock()) ffff93ff80205800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787848577.720987:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:2350:x1874694611517184:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 662us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848577.720995:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:1.0:1787848577.723704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848577.723859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848577.724028:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611517440 00000100:00100000:3.0:1787848577.724042:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611517440 00000100:00100000:3.0:1787848577.724114:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:3.0:1787848577.724126:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:13889:x1874694611517440:12345-192.168.201.26@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787848577.724619:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611517312 00000100:00100000:2.0:1787848577.724625:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611517312 00000100:00100000:2.0:1787848577.724711:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:2.0:1787848577.724720:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1874694611517312:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787848577.724754:0:15026:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from c6b00587-f481-427a-8e8d-8f0f46610c6c@192.168.201.26@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1787848577.724796:0:15026:0:(genops.c:1385:class_connect()) connect: client c6b00587-f481-427a-8e8d-8f0f46610c6c, cookie 0x9aeb41e0543cc90f 00002000:00100000:2.0:1787848577.724812:0:15026:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c6b00587-f481-427a-8e8d-8f0f46610c6c/ffff93ff80207000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787848577.724827:0:15026:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787848577.725073:0:15026:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787848577.725111:0:15026:0:(import.c:65:import_set_state_nolock()) ffff93ff80201800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787848577.725197:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:2350:x1874694611517312:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 476us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848577.725206:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000004:00200000:0.0:1787848577.729989:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787848577.730465:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:13889:x1874694611517440:12345-192.168.201.26@tcp:33:mount.lustre.0 Request processed in 6322us (6585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848577.730480:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:0.0:1787848577.893688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848577.893899:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611517568 00000100:00100000:3.0:1787848577.893914:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611517568 00000100:00100000:3.0:1787848577.893998:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:3.0:1787848577.894011:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:13920:x1874694611517568:12345-192.168.201.26@tcp:101:mkdir.0 00010000:00010000:3.0:1787848577.894040:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848577.894070:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc916 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb672 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848577.894171:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848577.894190:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848577.894206:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848577.894503:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787848577.894509:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848577.894601:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848577.894693:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237800/0x9aeb41e0543cc916 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb672 expref: 8 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848577.894732:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb672 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848577.894753:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1d00) 00010000:00010000:3.0:1787848577.894757:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787848577.894762:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff79237a00, rc 0) 00000100:00100000:3.0:1787848577.894849:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6b00587-f481-427a-8e8d-8f0f46610c6c+7:13920:x1874694611517568:12345-192.168.201.26@tcp:101:mkdir.0 Request processed in 840us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848577.894858:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00010000:00010000:1.0:1787848578.225420:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848579.247960:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787848579.497842:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c6b00587-f481-427a-8e8d-8f0f46610c6c 00000001:00100000:3.0:1787848579.497860:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 529328da-5578-45e5-bbcb-fef88c94f123 00000100:00100000:3.0:1787848579.953709:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631440256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848579.953788:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848579.955788:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631440256 00000100:00100000:2.0:1787848579.955806:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631440256 00000100:00100000:2.0:1787848579.955907:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787848579.955937:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631440256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787848579.955988:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787848579.956324:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848579.956737:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631440256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 802us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848579.956746:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787848579.972619:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631440256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787848580.272774:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787848581.158232:0:16307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787848581.301003:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848581.488157:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631440512:0@lo:400:kworker.0 00000100:00100000:0.0:1787848581.488229:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848581.488283:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79441a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631441024:0@lo:400:kworker.0 00000100:00100000:0.0:1787848581.488313:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848581.488342:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787848581.488361:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631440640:0@lo:400:kworker.0 00000100:00100000:0.0:1787848581.488387:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848581.488454:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631441024 00000100:00100000:0.0:1787848581.488461:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631441024 00000100:00100000:0.0:1787848581.488521:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787848581.488531:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79442d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631441024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848581.488583:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79442d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874694631441024:12345-0@lo:400:kworker.0 Request processed in 54us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848581.488591:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787848581.488617:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631440512 00000100:00100000:0.0:1787848581.488622:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631440512 00000100:00100000:0.0:1787848581.488673:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631440640 00000100:00100000:0.0:1787848581.488676:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631440640 00000100:00100000:0.0:1787848581.488697:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787848581.488865:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79442580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631440768:0@lo:400:kworker.0 00000100:00100000:3.0:1787848581.488897:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848581.488927:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787848581.488934:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff807e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631440384:0@lo:400:kworker.0 00000100:00100000:3.0:1787848581.488960:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848581.488986:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631440896:0@lo:400:kworker.0 00000100:00100000:3.0:1787848581.489008:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848581.489033:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631440768 00000100:00100000:3.0:1787848581.489036:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631440768 00000100:00100000:3.0:1787848581.489056:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631440896 00000100:00100000:3.0:1787848581.489058:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631440896 00000100:00100000:3.0:1787848581.489070:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787848581.489085:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631440768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848581.489119:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874694631440768:12345-0@lo:400:kworker.0 Request processed in 35us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848581.489125:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787848581.489137:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787848581.489142:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631440896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848581.489164:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874694631440896:12345-0@lo:400:kworker.0 Request processed in 22us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848581.489169:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787848581.489202:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874694631440896:0@lo:400:kworker.0 00000100:00100000:3.0:1787848581.489212:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79442580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874694631440768:0@lo:400:kworker.0 00000100:00080000:3.0:1787848581.489255:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848581.489259:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787848581.489262:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848581.489277:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79441a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874694631441024:0@lo:400:kworker.0 00000100:00100000:3.0:1787848581.489305:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631440384 00000100:00100000:3.0:1787848581.489308:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631440384 00000100:00100000:3.0:1787848581.489331:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787848581.489338:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff42b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3312:x1874694631440384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848581.489369:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff42b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3312:x1874694631440384:12345-0@lo:400:kworker.0 Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848581.489375:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787848581.489417:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631440384:0@lo:400:kworker.0 00000100:00100000:0.0:1787848581.489815:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79441680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631440512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848581.489859:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79441680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631440512:12345-0@lo:400:kworker.0 Request processed in 49us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848581.492286:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631440512:0@lo:400:kworker.0 00000100:00100000:1.0:1787848581.492310:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787848581.492326:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631441152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848581.492382:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848581.492439:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631441152 00000100:00100000:1.0:1787848581.492445:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631441152 00000100:00100000:1.0:1787848581.492499:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787848581.492508:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631441152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787848581.492539:0:15031:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848581.492581:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874694631441152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848581.492589:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787848581.492627:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55ae6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631441152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787848581.498898:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787848581.498944:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79443840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631440640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848581.499070:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79443840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631440640:12345-0@lo:400:kworker.0 Request processed in 148us (10682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848581.499080:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787848581.499157:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff807e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631440640:0@lo:400:kworker.0 00000100:00100000:0.0:1787848581.508351:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:00100000:2.0:1787848581.578873:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6b00587-f481-427a-8e8d-8f0f46610c6c 00010000:00010000:1.0:1787848582.323786:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787848582.619737:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c6b00587-f481-427a-8e8d-8f0f46610c6c 00000100:00100000:1.0:1787848582.857818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848582.857904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848582.857940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848582.857965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848582.857987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848582.858006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848582.858032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848582.858057:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611517952 00000100:00100000:1.0:1787848582.858066:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611517952 00000100:00100000:1.0:1787848582.858124:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611518080 00000100:00100000:1.0:1787848582.858128:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611518080 00000100:00100000:1.0:1787848582.858142:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611518336 00000100:00100000:1.0:1787848582.858145:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611518336 00000100:00100000:1.0:1787848582.858159:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611518464 00000100:00100000:1.0:1787848582.858161:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611518464 00000100:00100000:1.0:1787848582.858175:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:1.0:1787848582.858184:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:529328da-5578-45e5-bbcb-fef88c94f123+5:2352:x1874694611517952:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848582.858257:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:529328da-5578-45e5-bbcb-fef88c94f123+5:2352:x1874694611517952:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 74us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848582.858266:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:1.0:1787848582.858300:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:1.0:1787848582.858306:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:529328da-5578-45e5-bbcb-fef88c94f123+5:2351:x1874694611518080:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848582.858332:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:529328da-5578-45e5-bbcb-fef88c94f123+5:2351:x1874694611518080:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848582.858338:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:1.0:1787848582.858350:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:1.0:1787848582.858356:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2351:x1874694611518336:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848582.858392:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2351:x1874694611518336:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 36us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848582.858410:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:1.0:1787848582.858426:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:1.0:1787848582.858432:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2351:x1874694611518464:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848582.858455:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2351:x1874694611518464:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 24us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848582.858460:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:1.0:1787848582.858480:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611517824 00000100:00100000:1.0:1787848582.858483:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611517824 00000100:00100000:1.0:1787848582.858512:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611518208 00000100:00100000:1.0:1787848582.858515:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611518208 00000100:00100000:1.0:1787848582.858536:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:1.0:1787848582.858543:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55ae6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+6:2351:x1874694611517824:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848582.858571:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55ae6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+6:2351:x1874694611517824:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 29us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848582.858577:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:1.0:1787848582.858596:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:1.0:1787848582.858602:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:2352:x1874694611518208:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787848582.858626:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:2352:x1874694611518208:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 25us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848582.858632:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00080000:1.0:1787848582.860187:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787848582.860195:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787848582.860198:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787848582.863130:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611517696 00000100:00100000:3.0:1787848582.863152:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611517696 00000100:00100000:3.0:1787848582.863294:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 107 00000100:00100000:3.0:1787848582.863306:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:2352:x1874694611517696:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848582.863405:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:2352:x1874694611517696:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 101us (5766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848582.863414:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 107 00010000:00010000:0.0:1787848583.347261:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787848584.368812:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848585.074107:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631441280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848585.074199:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848585.074288:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631441280 00000100:00100000:0.0:1787848585.074309:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631441280 00000100:00100000:0.0:1787848585.074404:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787848585.074411:0:15030:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787848585.074418:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631441280:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787848585.074421:0:15030:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1787848585.074480:0:15031:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848585.074541:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631441280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848585.074549:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787848585.074619:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631441280:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787848585.074785:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787848585.393317:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787848585.886274:0:16457:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3eb23ae0 20000000:00000080:1.0:1787848585.886293:0:16457:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93fe41f94c00 uarg=0000000000000000 20000000:01000000:1.0:1787848585.886342:0:16457:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787848585.886348:0:16457:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787848585.886352:0:16457:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787848585.887169:0:16458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787848585.887340:0:16457:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787848585.895530:0:16457:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787848585.895581:0:16457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.895598:0:16457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff79236c00/0x9aeb41e0543cc61b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc614 expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.895606:0:16457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff79236600/0x9aeb41e0543cc668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc661 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.895612:0:16457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93fe41b56c00/0x9aeb41e0543cc7a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc79c expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.896193:0:16457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff79236800/0x9aeb41e0543cc8c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5e6 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.896200:0:16457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ff50664c00/0x9aeb41e0543cc8fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb648 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.896210:0:16457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.896260:0:16457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff50664c00/0x9aeb41e0543cc8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb648 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.896276:0:16457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff50664c00/0x9aeb41e0543cc8fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb648 expref: 12 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848585.896292:0:16457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1874694631441408:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848585.898027:0:16457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff79236800/0x9aeb41e0543cc8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5e6 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.898045:0:16457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff79236800/0x9aeb41e0543cc8c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5e6 expref: 12 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848585.898059:0:16457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1874694631441536:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848585.898198:0:16457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93fe41b56c00/0x9aeb41e0543cc7a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cc79c expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.898205:0:16457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93fe41b56c00/0x9aeb41e0543cc7a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cc79c expref: 18 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848585.898228:0:16457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1874694631441664:0@lo:104: 00000100:00100000:2.0:1787848585.898264:0:16457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787848585.898295:0:16457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff79236600/0x9aeb41e0543cc668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cc661 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.898301:0:16457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff79236600/0x9aeb41e0543cc668 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cc661 expref: 18 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848585.898307:0:16457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1874694631441792:0@lo:104: 00000100:00100000:2.0:1787848585.898334:0:16457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787848585.898354:0:16457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ff79236c00/0x9aeb41e0543cc61b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aeb41e0543cc614 expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848585.898362:0:16457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ff79236c00/0x9aeb41e0543cc61b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aeb41e0543cc614 expref: 18 pid: 14337 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848585.898370:0:16457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d09680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1874694631441920:0@lo:104: 00000100:00100000:2.0:1787848585.898391:0:16457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848585.898401:0:16457:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff44eec180 going to sleep for 11 seconds 00000100:00100000:0.0:1787848585.898560:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787848585.898575:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631441664 00000100:00100000:0.0:1787848585.898582:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631441664 00000100:00100000:0.0:1787848585.898624:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631441792 00000100:00100000:0.0:1787848585.898627:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631441792 00000100:00100000:0.0:1787848585.898637:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631441920 00000100:00100000:0.0:1787848585.898750:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631441920 00000100:00100000:0.0:1787848585.898772:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787848585.898780:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+5:16457:x1874694631441664:12345-0@lo:104: 00010000:00010000:0.0:1787848585.898793:0:14326:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.898851:0:14326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787848585.898858:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+5:16457:x1874694631441664:12345-0@lo:104: Request processed in 79us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848585.898864:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787848585.898880:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787848585.898886:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+4:16457:x1874694631441792:12345-0@lo:104: 00010000:00010000:0.0:1787848585.898894:0:14326:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.898942:0:14326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787848585.898947:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+4:16457:x1874694631441792:12345-0@lo:104: Request processed in 62us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848585.898954:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787848585.898965:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787848585.898971:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8024b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+3:16457:x1874694631441920:12345-0@lo:104: 00010000:00010000:0.0:1787848585.898987:0:14326:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899023:0:14326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787848585.899029:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8024b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+3:16457:x1874694631441920:12345-0@lo:104: Request processed in 58us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848585.899035:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787848585.899077:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787848585.899082:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899089:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff79237e00 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:0.0:1787848585.899093:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899101:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848585.899108:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848585.899113:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787848585.899142:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899149:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787848585.899167:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899175:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff79237e00/0x9aeb41e0543cc79c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc7a3 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899196:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787848585.899198:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899204:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff40030400 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:0.0:1787848585.899207:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899213:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848585.899219:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848585.899225:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787848585.899237:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899244:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787848585.899259:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899266:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff40030400/0x9aeb41e0543cc661 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc668 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899275:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848585.899278:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899293:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e000 already unused, calling callback (ffffffffc1b83c20) 10000000:00010000:0.0:1787848585.899296:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899302:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787848585.899308:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848585.899325:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787848585.899339:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899346:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787848585.899352:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899359:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e000/0x9aeb41e0543cc614 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aeb41e0543cc61b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.899373:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848585.899375:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848585.899376:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848585.899382:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848585.899387:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848585.899398:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79440780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631442048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848585.899567:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848585.899617:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff794412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631442176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848585.900408:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848585.900528:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787848585.900537:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631442304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848585.900569:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848585.900604:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631442048 00000100:00100000:0.0:1787848585.900611:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631442048 00010000:00010000:0.0:1787848585.900745:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93fe41b56c00/0x9aeb41e0543cc7a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc79c expref: 19 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848585.900769:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631442176 00000100:00100000:0.0:1787848585.900772:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631442176 00010000:00010000:0.0:1787848585.900785:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff79236600/0x9aeb41e0543cc668 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc661 expref: 20 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848585.900794:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631442304 00000100:00100000:0.0:1787848585.900797:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631442304 00010000:00010000:0.0:1787848585.900807:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff79236c00/0x9aeb41e0543cc61b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc614 expref: 21 pid: 14337 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848585.900817:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787848585.900824:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79442940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+21:3313:x1874694631442048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787848585.900837:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848585.900842:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93fe41b56c00/0x9aeb41e0543cc7a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc79c expref: 21 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.900851:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93fe41b56c00/0x9aeb41e0543cc7a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cc79c expref: 21 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.900871:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848585.900906:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79442940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+21:3313:x1874694631442048:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1339us total) trans 0 rc 0/0 00010000:00010000:2.0:1787848585.901061:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93fe41b56c00/0x9aeb41e0543cc7a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cc79c expref: 21 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848585.901072:0:16457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d09a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1874694631441664:0@lo:104: 00000100:00100000:2.0:1787848585.901083:0:16457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1874694631441792:0@lo:104: 00000100:00100000:2.0:1787848585.901090:0:16457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d09680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1874694631441920:0@lo:104: 00000100:00100000:0.0:1787848585.901141:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787848585.901160:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787848585.901166:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79440b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3310:x1874694631442176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787848585.901173:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848585.901177:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff79236600/0x9aeb41e0543cc668 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc661 expref: 19 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.901185:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff79236600/0x9aeb41e0543cc668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cc661 expref: 19 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.901195:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff79236600/0x9aeb41e0543cc668 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cc661 expref: 19 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.901203:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848585.901272:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79440b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:3310:x1874694631442176:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848585.901279:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787848585.901292:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787848585.901298:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8136d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:3310:x1874694631442304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787848585.901306:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848585.901310:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff79236c00/0x9aeb41e0543cc61b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aeb41e0543cc614 expref: 17 pid: 14337 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.901327:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff79236c00/0x9aeb41e0543cc61b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aeb41e0543cc614 expref: 17 pid: 14337 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.901337:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff79236c00/0x9aeb41e0543cc61b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aeb41e0543cc614 expref: 17 pid: 14337 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.901356:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848585.901380:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8136d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:3310:x1874694631442304:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848585.901386:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787848585.901533:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79440780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631442048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787848585.903079:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848585.903109:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611518592 00000100:00100000:0.0:1787848585.903116:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611518592 00010000:00010000:0.0:1787848585.903149:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff50664c00/0x9aeb41e0543cc8fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb648 expref: 13 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848585.903179:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:0.0:1787848585.903189:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79440780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:2352:x1874694611518592:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848585.903201:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848585.903206:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff50664c00/0x9aeb41e0543cc8fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb648 expref: 13 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.903219:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff50664c00/0x9aeb41e0543cc8fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb648 expref: 13 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.903238:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848585.903287:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79440780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:2352:x1874694611518592:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 99us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848585.903294:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00010000:00010000:1.0:1787848585.903297:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff50664c00/0x9aeb41e0543cc8fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb648 expref: 13 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848585.903310:0:16457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d0a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1874694631441408:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848585.907144:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848585.907292:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611518720 00000100:00100000:0.0:1787848585.907303:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611518720 00000100:00100000:1.0:1787848585.907354:0:16457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1874694631441536:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848585.907364:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ff79236800/0x9aeb41e0543cc8c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5e6 expref: 12 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848585.907400:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:0.0:1787848585.907410:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54655a3a-d2df-4afc-9081-6ffd334ecd56+12:2351:x1874694611518720:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848585.907438:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848585.907445:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ff79236800/0x9aeb41e0543cc8c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5e6 expref: 12 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.907456:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ff79236800/0x9aeb41e0543cc8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5e6 expref: 12 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.907473:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff79236800/0x9aeb41e0543cc8c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb5e6 expref: 12 pid: 14338 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848585.907479:0:16457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.907491:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.907517:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848585.907570:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff794412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631442176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787848585.907603:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3310:1874694631442304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787848585.908413:0:14329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.908436:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.908444:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.908451:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.908472:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848585.908476:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.908485:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.908509:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848585.908523:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787848585.908651:0:16457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848585.908659:0:16457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848585.908666:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ff50665000/0x9aeb41e0543cc924 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848585.910192:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:2351:x1874694611518720:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 2773us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848585.910204:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00010000:00010000:0.0:1787848586.416067:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848586.610798:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787848586.610822:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631442432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848586.610893:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848586.617708:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631442432 00000100:00100000:1.0:1787848586.617726:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631442432 00000100:00100000:1.0:1787848586.617806:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787848586.617816:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631442432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787848586.617861:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848586.617938:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631442432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (7045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848586.617945:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787848586.618010:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631442432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787848586.620786:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631442816:0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.620867:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848586.620916:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787848586.620923:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631442688:0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.620949:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848586.620984:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631442816 00000100:00100000:0.0:1787848586.620990:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631442816 00000100:00100000:0.0:1787848586.621040:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787848586.621050:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79442940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631442816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621109:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79442940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631442816:12345-0@lo:400:kworker.0 Request processed in 60us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848586.621116:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787848586.621151:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631442688 00000100:00100000:0.0:1787848586.621155:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631442688 00000100:00100000:0.0:1787848586.621179:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787848586.621186:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79440b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631442688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621215:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79440b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631442688:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848586.621221:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787848586.621259:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631442688:0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621271:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631442816:0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621313:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631442560:0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621345:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848586.621376:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631443072:0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621411:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848586.621431:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848586.621437:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631442944:0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621457:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848586.621481:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631442560 00000100:00100000:0.0:1787848586.621485:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631442560 00000100:00100000:0.0:1787848586.621513:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787848586.621519:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:3313:x1874694631442560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621553:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:3313:x1874694631442560:12345-0@lo:400:kworker.0 Request processed in 34us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848586.621559:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787848586.621584:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631443072 00000100:00100000:0.0:1787848586.621587:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631443072 00000100:00100000:0.0:1787848586.621611:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631442944 00000100:00100000:0.0:1787848586.621621:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631442944 00000100:00100000:0.0:1787848586.621666:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787848586.621674:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631443072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621703:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631443072:12345-0@lo:400:kworker.0 Request processed in 31us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848586.621709:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787848586.621720:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787848586.621726:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631442944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621752:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874694631442944:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848586.621757:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787848586.621785:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874694631442944:0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621793:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3313:1874694631442560:0@lo:400:kworker.0 00000100:00100000:0.0:1787848586.621800:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631443072:0@lo:400:kworker.0 00000100:00080000:2.0:1787848586.622207:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787848586.622213:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1787848586.865284:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787848587.334383:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848587.334476:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611518848 00000100:00100000:2.0:1787848587.334487:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611518848 00000100:00100000:2.0:1787848587.334549:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 109 00000100:00100000:2.0:1787848587.334560:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+11:13773:x1874694611518848:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848587.334579:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848587.334609:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50665800/0x9aeb41e0543cc92b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb679 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848587.334662:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50665800/0x9aeb41e0543cc92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb679 expref: 12 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848587.334675:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50665800/0x9aeb41e0543cc92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb679 expref: 12 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848587.334686:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665800, rc 0) 00000100:00100000:2.0:1787848587.334752:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+12:13773:x1874694611518848:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 194us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848587.334760:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 109 00000100:00100000:0.0:1787848587.341275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848587.341358:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611518976 00000100:00100000:3.0:1787848587.341370:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611518976 00000100:00100000:3.0:1787848587.341440:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00100000:3.0:1787848587.341452:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+12:13773:x1874694611518976:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787848587.341978:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+12:13773:x1874694611518976:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 323us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848587.341989:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00100000:0.0:1787848587.353717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848587.353808:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611519104 00000100:00100000:1.0:1787848587.353817:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611519104 00000100:00100000:1.0:1787848587.353877:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 111 00000100:00100000:1.0:1787848587.353887:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+12:13773:x1874694611519104:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848587.354099:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+12:13773:x1874694611519104:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 213us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848587.354108:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 111 00000100:00100000:1.0:1787848587.398589:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848587.398721:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611519232 00000100:00100000:0.0:1787848587.398732:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611519232 00000100:00100000:0.0:1787848587.398805:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00100000:0.0:1787848587.398816:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+12:13773:x1874694611519232:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787848587.398834:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848587.398853:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93fe41b57a00/0x9aeb41e0543cc932 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb680 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848587.398884:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93fe41b57a00/0x9aeb41e0543cc932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb680 expref: 13 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848587.398905:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93fe41b57a00/0x9aeb41e0543cc932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb680 expref: 13 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848587.398914:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b57a00, rc 0) 00000100:00100000:0.0:1787848587.398975:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13773:x1874694611519232:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 161us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848587.398983:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00100000:1.0:1787848587.408153:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848587.408588:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611519360 00000100:00100000:3.0:1787848587.408607:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611519360 00000100:00100000:3.0:1787848587.408698:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:3.0:1787848587.408711:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13773:x1874694611519360:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787848587.409047:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13773:x1874694611519360:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 338us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848587.409056:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:0.0:1787848587.414982:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848587.415505:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611519488 00000100:00100000:1.0:1787848587.415517:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611519488 00000100:00100000:1.0:1787848587.415580:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:1.0:1787848587.415608:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13773:x1874694611519488:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848587.416305:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:13773:x1874694611519488:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 705us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848587.416315:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 114 00010000:00010000:0.0:1787848587.439885:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787848587.519894:0:14340:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787848587.519902:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff4306e000 from 10 10000000:01000000:1.0:1787848587.519908:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787848587.519956:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e600/0x9aeb41e0543cc939 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848587.519968:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e600/0x9aeb41e0543cc939 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848587.519978:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e600/0x9aeb41e0543cc939 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848587.520003:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787848587.520072:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848587.520129:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848587.520187:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631443200 00000100:00100000:0.0:1787848587.520195:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631443200 00000100:00100000:0.0:1787848587.520247:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787848587.520256:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+16:14340:x1874694631443200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787848587.520269:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848587.520292:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93fe41b57c00/0x9aeb41e0543cc940 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc939 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848587.520317:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93fe41b57c00/0x9aeb41e0543cc940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc939 expref: 17 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848587.520328:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93fe41b57c00/0x9aeb41e0543cc940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc939 expref: 17 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848587.520337:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b57c00, rc 0) 00000100:00100000:0.0:1787848587.520395:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:14340:x1874694631443200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848587.520409:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787848587.520540:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848587.520554:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e600/0x9aeb41e0543cc939 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc940 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848587.520563:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e600/0x9aeb41e0543cc939 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc940 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848587.520631:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848587.520686:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848587.520709:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848587.520985:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631443328 00000100:00100000:0.0:1787848587.520990:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631443328 00000100:00100000:0.0:1787848587.521021:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787848587.521029:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:14340:x1874694631443328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848587.521266:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:14340:x1874694631443328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848587.521274:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787848587.521349:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848587.521375:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848587.521421:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848587.521447:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff8028c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787848587.521545:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631443456 00000100:00100000:0.0:1787848587.521550:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631443456 00000100:00100000:0.0:1787848587.521584:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787848587.521591:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:14340:x1874694631443456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787848587.521760:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:14340:x1874694631443456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848587.521767:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787848587.521959:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787848587.527744:0:16510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787848587.527928:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787848587.527956:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787848587.527967:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e600/0x9aeb41e0543cc939 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc940 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848587.527979:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff5f42e600/0x9aeb41e0543cc939 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc940 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787848587.527989:0:14340:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787848587.527992:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff520f8800 from 10 10000000:01000000:0.0:1787848587.527995:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787848587.528031:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93fe41b56e00/0x9aeb41e0543cc947 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848587.528040:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93fe41b56e00/0x9aeb41e0543cc947 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848587.528058:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93fe41b56e00/0x9aeb41e0543cc947 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848587.528084:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff794421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787848587.528159:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848587.528214:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fbe1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787848587.529130:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631443584 00000100:00100000:2.0:1787848587.529139:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631443584 00000100:00100000:2.0:1787848587.529190:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787848587.529199:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+17:14340:x1874694631443584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848587.529223:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848587.529238:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cc94e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc947 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848587.529261:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cc94e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc947 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848587.529273:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff50664400/0x9aeb41e0543cc94e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc947 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848587.529282:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664400, rc 0) 00000100:00100000:2.0:1787848587.529345:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:14340:x1874694631443584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848587.529353:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787848587.529605:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff794421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787848587.529624:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93fe41b56e00/0x9aeb41e0543cc947 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc94e expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848587.529633:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93fe41b56e00/0x9aeb41e0543cc947 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc94e expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848587.529719:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff794421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848587.529749:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848587.529778:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fbe1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787848587.530754:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631443712 00000100:00100000:2.0:1787848587.530764:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631443712 00000100:00100000:2.0:1787848587.530802:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787848587.530811:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fc15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:14340:x1874694631443712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848587.531097:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fc15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:14340:x1874694631443712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848587.531106:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787848587.531633:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff794421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787848587.531703:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff794421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787848587.531751:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848587.531783:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff7fbe1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787848587.533745:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631443840 00000100:00100000:1.0:1787848587.533758:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631443840 00000100:00100000:1.0:1787848587.533810:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787848587.533819:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:14340:x1874694631443840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848587.534035:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:14340:x1874694631443840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848587.534043:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787848587.534346:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff794421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787848587.539945:0:16511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787848587.554201:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787848587.554234:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787848587.554245:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93fe41b56e00/0x9aeb41e0543cc947 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc94e expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848587.554258:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93fe41b56e00/0x9aeb41e0543cc947 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc94e expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787848587.554320:0:14340:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787848587.554324:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ff5ede2000 from 10 10000000:01000000:2.0:1787848587.554327:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787848587.554366:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cc955 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848587.554373:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cc955 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848587.554384:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cc955 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848587.554424:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787848587.555384:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848587.555440:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed60000 going to sleep for 11 seconds 00000100:00100000:1.0:1787848587.555499:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631443968 00000100:00100000:1.0:1787848587.555508:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631443968 00000100:00100000:1.0:1787848587.555560:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787848587.555570:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+18:14340:x1874694631443968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787848587.555591:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848587.555613:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ff5f42fa00/0x9aeb41e0543cc95c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aeb41e0543cc955 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848587.555658:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ff5f42fa00/0x9aeb41e0543cc95c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aeb41e0543cc955 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848587.555669:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ff5f42fa00/0x9aeb41e0543cc95c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aeb41e0543cc955 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848587.555689:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42fa00, rc 0) 00000100:00100000:1.0:1787848587.555737:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:14340:x1874694631443968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848587.555744:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787848587.556823:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631443968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787848587.556845:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cc955 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc95c expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848587.556855:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cc955 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aeb41e0543cc95c expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848587.556939:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631444096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848587.556986:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848587.557025:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed60000 going to sleep for 11 seconds 00000100:00100000:1.0:1787848587.557708:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631444096 00000100:00100000:1.0:1787848587.557716:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631444096 00000100:00100000:1.0:1787848587.557902:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787848587.557913:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:14340:x1874694631444096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787848587.558186:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:14340:x1874694631444096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848587.558193:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787848587.558428:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631444096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787848587.558470:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631444224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787848587.558529:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848587.558566:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed60000 going to sleep for 11 seconds 00000100:00100000:1.0:1787848587.562663:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631444224 00000100:00100000:1.0:1787848587.562681:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631444224 00000100:00100000:1.0:1787848587.562742:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787848587.562752:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:14340:x1874694631444224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787848587.562993:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:14340:x1874694631444224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (4462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848587.563002:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787848587.563280:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ee33ef1-6a45-464a-a8ac-d296b849f06b:14340:1874694631444224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787848587.564901:0:16513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787848587.565202:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787848587.565225:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787848587.565236:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cc955 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc95c expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848587.565248:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff93ff50664800/0x9aeb41e0543cc955 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aeb41e0543cc95c expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848587.989798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848587.989847:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848587.989929:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848587.990146:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611519744 00000100:00100000:0.0:1787848587.990169:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611519744 00000100:00100000:0.0:1787848587.990238:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:0.0:1787848587.990248:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+6:2353:x1874694611519744:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848587.990349:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+6:2353:x1874694611519744:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 102us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848587.990357:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00080000:0.0:1787848587.990392:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787848588.006874:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611520000 00000100:00100000:3.0:1787848588.006914:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611520000 00000100:00100000:3.0:1787848588.007502:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611520256 00000100:00100000:3.0:1787848588.007508:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611520256 00000100:00100000:0.0:1787848588.009070:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:0.0:1787848588.009085:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:529328da-5578-45e5-bbcb-fef88c94f123+5:2353:x1874694611520000:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848588.009334:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:529328da-5578-45e5-bbcb-fef88c94f123+5:2353:x1874694611520000:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 253us (19486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848588.009370:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:0.0:1787848588.010087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848588.012267:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848588.012315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848588.012348:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00080000:1.0:1787848588.012482:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787848588.012489:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787848588.012727:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611519616 00000100:00100000:0.0:1787848588.012737:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611519616 00000100:00100000:0.0:1787848588.016510:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 124 00000100:00100000:0.0:1787848588.016530:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:2353:x1874694611519616:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848588.016657:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:2353:x1874694611519616:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 134us (6572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848588.016665:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 124 00000100:00100000:3.0:1787848588.017099:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611519872 00000100:00100000:3.0:1787848588.017107:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611519872 00000100:00100000:3.0:1787848588.017129:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611520384 00000100:00100000:3.0:1787848588.017132:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611520384 00000100:00100000:3.0:1787848588.017149:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:3.0:1787848588.017157:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2353:x1874694611520256:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848588.017191:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2353:x1874694611520256:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 35us (27261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848588.017197:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:3.0:1787848588.017210:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:3.0:1787848588.017216:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:529328da-5578-45e5-bbcb-fef88c94f123+5:2353:x1874694611519872:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848588.017239:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:529328da-5578-45e5-bbcb-fef88c94f123+5:2353:x1874694611519872:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 23us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848588.017245:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:3.0:1787848588.017257:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:3.0:1787848588.017263:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79443c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2353:x1874694611520384:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848588.017297:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79443c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2353:x1874694611520384:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 34us (4948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848588.017304:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00080000:3.0:1787848588.017334:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848588.017338:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787848588.019508:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611520128 00000100:00100000:0.0:1787848588.019522:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611520128 00000100:00100000:0.0:1787848588.019750:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:0.0:1787848588.019779:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:2353:x1874694611520128:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848588.019852:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:2353:x1874694611520128:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 76us (7535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848588.019860:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00080000:3.0:1787848588.020878:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787848588.466178:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848589.489669:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787848590.194441:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787848590.196696:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631444352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848590.196801:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848590.197162:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631444352 00000100:00100000:3.0:1787848590.197170:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631444352 00000100:00100000:3.0:1787848590.197296:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787848590.197307:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631444352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787848590.197355:0:16426:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787848590.197415:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874694631444352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848590.197423:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787848590.197760:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874694631444352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787848590.198552:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787848590.504816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848590.505228:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611520512 00000100:00100000:1.0:1787848590.505268:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611520512 00000100:00100000:1.0:1787848590.505363:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:1.0:1787848590.505375:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+6:14430:x1874694611520512:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787848590.505399:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848590.505424:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cc963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb687 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.505513:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc96a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.505529:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc96a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.505543:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc96a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.505559:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc971 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.505567:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.505573:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787848590.506146:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787848590.506562:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc978 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506576:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc978 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506593:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc978 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848590.506697:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787848590.506701:0:14343:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848590.506797:0:14343:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc978 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506810:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc96a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506817:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc96a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506824:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc96a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506830:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848590.506834:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc96a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506842:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc96a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506856:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1d00) 00010000:00010000:1.0:1787848590.506859:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848590.506863:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc96a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506869:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc96a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506892:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506898:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc971 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506904:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc971 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506908:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ee00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848590.506911:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc971 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506917:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc971 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.506926:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93ff5685b100) 00010000:00010000:1.0:1787848590.506928:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848590.507197:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc971 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.507204:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc971 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.507258:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543cc963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb687 expref: 8 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.507272:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f600/0x9aeb41e0543cc978 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb687 expref: 7 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.507292:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ff5685bd00) 00010000:00010000:1.0:1787848590.507294:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787848590.507298:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f600, rc 0) 00000100:00100000:1.0:1787848590.507741:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+7:14430:x1874694611520512:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 2365us (2933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848590.507750:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00010000:00010000:2.0:1787848590.514266:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848590.525483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848590.530857:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611520768 00000100:00100000:2.0:1787848590.530872:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611520768 00000100:00100000:2.0:1787848590.530963:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:2.0:1787848590.530975:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79441e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+7:14430:x1874694611520768:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848590.530997:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848590.531032:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc97f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb68e expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.531763:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc986 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.531781:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc986 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.531798:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc986 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.531881:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc98d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.531890:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc98d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.531897:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc98d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535090:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc994 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535115:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc994 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535135:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc994 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848590.535149:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787848590.535444:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc986 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535452:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc986 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535459:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc986 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535464:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848590.535476:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc986 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535602:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc986 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535617:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ff5685bd00) 00010000:00010000:2.0:1787848590.535621:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848590.535626:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc986 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535633:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc986 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535816:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc98d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535821:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc98d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535828:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc98d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535832:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848590.535835:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc98d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535842:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc98d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535850:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93ff53a89500) 00010000:00010000:2.0:1787848590.535852:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848590.535855:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc98d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.535870:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc98d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.536311:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc97f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb68e expref: 10 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.536328:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664c00/0x9aeb41e0543cc994 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb68e expref: 9 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.536336:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff53a89600) 00010000:00010000:2.0:1787848590.536338:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848590.536341:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664c00, rc 0) 00000100:00100000:2.0:1787848590.536422:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79441e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+9:14430:x1874694611520768:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 5448us (10958us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787848590.536432:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:0.0:1787848590.554617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848590.554786:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611520896 00000100:00100000:2.0:1787848590.554799:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611520896 00000100:00100000:2.0:1787848590.554865:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:2.0:1787848590.554877:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff794412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+9:14430:x1874694611520896:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787848590.554997:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff794412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+9:14430:x1874694611520896:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 Request processed in 123us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848590.555013:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:0.0:1787848590.639137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848590.639285:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611521024 00000100:00100000:2.0:1787848590.639297:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611521024 00000100:00100000:2.0:1787848590.639362:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:2.0:1787848590.639372:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+9:14437:x1874694611521024:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848590.639411:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848590.639435:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb695 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.639507:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc9a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.639522:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc9a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.639533:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc9a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.639550:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc9b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.639557:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.639563:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.639880:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc9a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.639889:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc9a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.639895:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc9a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.639902:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848590.639911:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc9a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.639919:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc9a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640190:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1d00) 00010000:00010000:2.0:1787848590.640195:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848590.640202:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc9a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640208:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cc9a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640223:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640237:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc9b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640244:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc9b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640249:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848590.640252:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc9b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640257:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc9b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640265:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93ff53a89500) 00010000:00010000:2.0:1787848590.640267:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848590.640276:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc9b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640282:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cc9b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640324:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb695 expref: 10 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640334:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1d00) 00010000:00010000:2.0:1787848590.640336:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848590.640340:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb695 expref: 10 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.640349:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665000, rc 0) 00000100:00100000:2.0:1787848590.640424:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+9:14437:x1874694611521024:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1051us (1309us total) trans 0 rc 301/301 00000100:00100000:2.0:1787848590.640433:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:0.0:1787848590.653580:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848590.653761:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611521152 00000100:00100000:1.0:1787848590.653775:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611521152 00000100:00100000:1.0:1787848590.653845:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:1.0:1787848590.653857:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79442580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:529328da-5578-45e5-bbcb-fef88c94f123+9:14437:x1874694611521152:12345-192.168.201.26@tcp:700:lfs.0 00000100:00100000:1.0:1787848590.654397:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79442580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:529328da-5578-45e5-bbcb-fef88c94f123+9:14437:x1874694611521152:12345-192.168.201.26@tcp:700:lfs.0 Request processed in 540us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848590.654407:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:1.0:1787848590.666500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848590.666610:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611521408 00000100:00100000:2.0:1787848590.666621:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611521408 00000100:00100000:2.0:1787848590.666716:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:2.0:1787848590.666728:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+9:14437:x1874694611521408:12345-192.168.201.26@tcp:36:lfs.0 00010000:00010000:2.0:1787848590.666801:0:15051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848590.666830:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237c00/0x9aeb41e0543cc8e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb610 expref: 9 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.666850:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1d00) 00010000:00010000:2.0:1787848590.666855:0:15051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848590.667209:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.667223:0:15051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb672 expref: 5 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.667243:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.667283:0:15051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb672 expref: 5 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.667298:0:15051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb672 expref: 5 pid: 14345 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848590.667314:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15051:1874694631444480:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848590.667433:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed60240 going to sleep for 11 seconds 00000100:00100000:0.0:1787848590.670413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848590.670603:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15051:1874694631444480:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848590.670687:0:15051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848590.670932:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611521536 00000100:00100000:3.0:1787848590.670942:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611521536 00010000:00010000:3.0:1787848590.671001:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb672 expref: 6 pid: 14345 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848590.671046:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:3.0:1787848590.671057:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:2351:x1874694611521536:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848590.671077:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848590.671085:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb672 expref: 6 pid: 14345 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.671099:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb672 expref: 6 pid: 14345 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.671126:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff79237a00/0x9aeb41e0543cc91d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb672 expref: 6 pid: 14345 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.671146:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1d00) 00010000:00010000:3.0:1787848590.671152:0:14328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.671162:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.671190:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.671350:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848590.671444:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2351:x1874694611521536:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 388us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848590.671456:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00080000:0.0:1787848590.671535:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787848590.675015:0:15051:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.675039:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.675275:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc9be lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.675292:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc9be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.675305:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc9be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848590.679464:0:15051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787848590.679494:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.679507:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.679515:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.679895:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848590.679901:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.679911:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.679933:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff541a1d00) 00010000:00010000:1.0:1787848590.679936:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848590.679943:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.679950:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cc9b7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787848590.679981:0:15051:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056d72c5e reply state 0000000011c09ede transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc9be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848590.679993:0:15051:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787848590.680190:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+10:14437:x1874694611521408:12345-192.168.201.26@tcp:36:lfs.0 Request processed in 13459us (13697us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787848590.680220:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00010000:00010000:3.0:1787848590.683461:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc9be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.683485:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc9be lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.683494:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc9be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.683501:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42ee00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848590.683506:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc9be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.683514:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc9be lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.683741:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93ff5685b100) 00010000:00010000:3.0:1787848590.683745:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848590.683752:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc9be lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.683759:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543cc9be lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848590.808119:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848590.808278:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611521664 00000100:00100000:0.0:1787848590.808294:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611521664 00000100:00100000:0.0:1787848590.808394:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787848590.808409:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+9:14445:x1874694611521664:12345-192.168.201.26@tcp:101:lctl.0 00010000:00010000:0.0:1787848590.808447:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848590.808484:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56200/0x9aeb41e0543cc9c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb69c expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.808579:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56000/0x9aeb41e0543cc9cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.808594:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56000/0x9aeb41e0543cc9cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.808678:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56000/0x9aeb41e0543cc9cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848590.808815:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787848590.808821:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848590.808884:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56000/0x9aeb41e0543cc9cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.808919:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56200/0x9aeb41e0543cc9c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb69c expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.809015:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56000/0x9aeb41e0543cc9cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb69c expref: 10 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.809027:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff42d05b00) 00010000:00010000:1.0:1787848590.809030:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787848590.809035:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b56000, rc 0) 00000100:00100000:1.0:1787848590.809306:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+10:14445:x1874694611521664:12345-192.168.201.26@tcp:101:lctl.0 Request processed in 899us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848590.809314:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787848590.846912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848590.847063:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611521792 00000100:00100000:1.0:1787848590.847079:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611521792 00000100:00100000:1.0:1787848590.847187:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:1.0:1787848590.847201:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:14446:x1874694611521792:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848590.847238:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848590.847269:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc9d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6a3 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.847862:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc9da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.847900:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc9da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.847918:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc9da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848590.848009:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787848590.848015:0:14343:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848590.848049:0:14343:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc9da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.848080:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cc9d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6a3 expref: 7 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.848099:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f200/0x9aeb41e0543cc9da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6a3 expref: 6 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.848106:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff42d05b00) 00010000:00010000:1.0:1787848590.848108:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787848590.848112:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f200, rc 0) 00000100:00100000:1.0:1787848590.848772:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:14446:x1874694611521792:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1569us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848590.848785:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:2.0:1787848590.852757:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848590.852897:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611521920 00000100:00100000:0.0:1787848590.852909:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611521920 00000100:00100000:0.0:1787848590.852982:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:0.0:1787848590.852995:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:14446:x1874694611521920:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787848590.853023:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848590.853049:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56a00/0x9aeb41e0543cc9e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6aa expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853141:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543cc9e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853158:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543cc9e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853170:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543cc9e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853187:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543cc9ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853194:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543cc9ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853200:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543cc9ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853410:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56200/0x9aeb41e0543cc9f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853419:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56200/0x9aeb41e0543cc9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853426:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56200/0x9aeb41e0543cc9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848590.853477:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787848590.853482:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848590.853515:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56200/0x9aeb41e0543cc9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853530:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543cc9e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853538:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543cc9e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853544:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543cc9e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853549:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b56c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848590.853553:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543cc9e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853560:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543cc9e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853571:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff42d05b00) 00010000:00010000:0.0:1787848590.853580:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848590.853585:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543cc9e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853590:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543cc9e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853711:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543cc9ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853719:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543cc9ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853724:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543cc9ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853730:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b57200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848590.853733:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543cc9ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853740:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543cc9ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853748:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93ff42d05000) 00010000:00010000:0.0:1787848590.853751:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848590.853754:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543cc9ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853759:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543cc9ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853802:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56a00/0x9aeb41e0543cc9e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6aa expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853823:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56200/0x9aeb41e0543cc9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6aa expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848590.853828:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ff42d05e00) 00010000:00010000:0.0:1787848590.853830:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787848590.853832:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b56200, rc 0) 00000100:00100000:1.0:1787848590.853962:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+7:14446:x1874694611521920:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 966us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848590.853972:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:3.0:1787848590.859747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848590.860207:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611522176 00000100:00100000:2.0:1787848590.860221:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611522176 00000100:00100000:2.0:1787848590.860374:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:2.0:1787848590.860387:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6b00587-f481-427a-8e8d-8f0f46610c6c+7:14446:x1874694611522176:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848590.860422:0:15051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848590.860476:0:15051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc9fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6b1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848590.860680:0:15051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787848590.860848:0:15051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc9fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6b1 expref: 9 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.860867:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff42d05b00) 00010000:00010000:2.0:1787848590.860870:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787848590.860876:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cc9fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6b1 expref: 9 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.860891:0:15051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665200, rc 0) 00000100:00100000:2.0:1787848590.860979:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6b00587-f481-427a-8e8d-8f0f46610c6c+8:14446:x1874694611522176:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 595us (1250us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787848590.860988:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:0.0:1787848590.864727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848590.864874:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611522432 00000100:00100000:1.0:1787848590.864888:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611522432 00000100:00100000:1.0:1787848590.864986:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:1.0:1787848590.864997:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6b00587-f481-427a-8e8d-8f0f46610c6c+8:14446:x1874694611522432:12345-192.168.201.26@tcp:36:lfs.0 00010000:00010000:1.0:1787848590.865075:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848590.866067:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56200/0x9aeb41e0543cc9f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6aa expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.866099:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ff42d05e00) 00010000:00010000:1.0:1787848590.866119:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787848590.866161:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cca0b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.866191:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cca0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.866202:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cca0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787848590.866539:0:14345:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085cbd72c reply state 00000000eaecb57c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cca0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848590.866550:0:14345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787848590.866598:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787848590.866747:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6b00587-f481-427a-8e8d-8f0f46610c6c+9:14446:x1874694611522432:12345-192.168.201.26@tcp:36:lfs.0 Request processed in 1749us (2440us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787848590.866758:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:0.0:1787848590.870813:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848590.870930:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611522688 00000100:00100000:2.0:1787848590.870944:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611522688 00000100:00100000:2.0:1787848590.871017:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:2.0:1787848590.871029:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+9:14446:x1874694611522688:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787848590.871636:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+10:14446:x1874694611522688:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 607us (837us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787848590.871679:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00010000:00010000:3.0:1787848590.871883:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cca0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.871894:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cca0b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.871900:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cca0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.871904:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848590.871908:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cca0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.871915:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cca0b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.871932:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:3.0:1787848590.871935:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787848590.871940:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cca0b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848590.871946:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f400/0x9aeb41e0543cca0b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848590.883999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848590.884582:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611522944 00000100:00100000:1.0:1787848590.884595:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611522944 00000100:00100000:1.0:1787848590.884709:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:1.0:1787848590.884720:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6b00587-f481-427a-8e8d-8f0f46610c6c+9:14446:x1874694611522944:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848590.884775:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848590.884801:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6b8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.884890:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.884907:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.884920:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.884936:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.884944:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.884952:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848590.885108:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787848590.885509:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885518:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885525:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885542:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848590.885548:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885556:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885571:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff42d05b00) 00010000:00010000:1.0:1787848590.885574:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848590.885579:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885586:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885602:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885608:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885614:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885619:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848590.885622:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885627:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885687:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93ff5685be00) 00010000:00010000:1.0:1787848590.885690:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848590.885693:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885700:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885748:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca12 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6b8 expref: 11 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885758:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff42d05b00) 00010000:00010000:1.0:1787848590.885760:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787848590.885764:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6b8 expref: 11 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.885773:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e400, rc 0) 00000100:00100000:1.0:1787848590.885867:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6b00587-f481-427a-8e8d-8f0f46610c6c+10:14446:x1874694611522944:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1148us (1884us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787848590.885875:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:0.0:1787848590.892414:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848590.892573:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611523072 00000100:00100000:2.0:1787848590.892587:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611523072 00000100:00100000:2.0:1787848590.892694:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:2.0:1787848590.892707:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+10:14446:x1874694611523072:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787848590.892765:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848590.892797:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca2e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6bf expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.892925:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.892944:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.892957:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848590.893042:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787848590.893047:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787848590.893080:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.893131:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca2e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6bf expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.893152:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6bf expref: 11 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.893161:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:2.0:1787848590.893164:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787848590.893169:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665c00, rc 0) 00000100:00100000:2.0:1787848590.893258:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+11:14446:x1874694611523072:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 553us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848590.893267:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:3.0:1787848590.898733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848590.899129:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611523200 00000100:00100000:2.0:1787848590.899144:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611523200 00000100:00100000:2.0:1787848590.899222:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:2.0:1787848590.899245:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+11:14446:x1874694611523200:12345-192.168.201.26@tcp:37:lfs.0 00000100:00100000:2.0:1787848590.905999:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+11:14446:x1874694611523200:12345-192.168.201.26@tcp:37:lfs.0 Request processed in 6730us (7260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848590.906018:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:0.0:1787848590.913789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848590.913936:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611523456 00000100:00100000:1.0:1787848590.913950:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611523456 00000100:00100000:1.0:1787848590.914029:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:1.0:1787848590.914042:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f68e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6b00587-f481-427a-8e8d-8f0f46610c6c+11:14446:x1874694611523456:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787848590.914459:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f68e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6b00587-f481-427a-8e8d-8f0f46610c6c+12:14446:x1874694611523456:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 417us (687us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787848590.914467:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00000040:00080000:2.0:1787848590.963201:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787848590.988894:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848590.989098:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611523584 00000100:00100000:1.0:1787848590.989122:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611523584 00000100:00100000:1.0:1787848590.989205:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:1.0:1787848590.989218:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+10:14452:x1874694611523584:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787848590.989257:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848590.989285:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6c6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.989374:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.989393:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.989577:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.989607:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.989616:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.989624:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.989898:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cca51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.989908:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cca51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.989937:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cca51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848590.989981:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787848590.989986:0:14343:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787848590.990040:0:14343:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cca51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990057:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990063:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca43 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990069:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990075:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848590.990080:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990088:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990104:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff42d05b00) 00010000:00010000:1.0:1787848590.990219:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848590.990236:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990244:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990274:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990280:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990286:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990291:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848590.990294:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990300:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990309:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93ff5685be00) 00010000:00010000:1.0:1787848590.990311:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848590.990314:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca4a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990320:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990367:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6c6 expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.990383:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42fc00/0x9aeb41e0543cca51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6c6 expref: 11 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848590.992771:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:1.0:1787848590.992777:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787848590.992783:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42fc00, rc 0) 00000100:00100000:1.0:1787848590.992908:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+11:14452:x1874694611523584:12345-192.168.201.26@tcp:101:bash.0 Request processed in 3686us (4022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848590.992920:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:3.0:1787848590.999377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848590.999493:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611523840 00000100:00100000:2.0:1787848590.999511:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611523840 00000100:00100000:2.0:1787848590.999624:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:2.0:1787848590.999667:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+11:14452:x1874694611523840:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787848590.999701:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848590.999734:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca58 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6cd expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.999926:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.999946:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6bf expref: 11 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.999955:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848590.999999:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6bf expref: 11 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848591.000040:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6bf expref: 11 pid: 14344 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848591.000057:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff58d08780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1874694631444608:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848591.000190:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed60240 going to sleep for 11 seconds 00000100:00100000:2.0:1787848591.024609:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff58d08780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1874694631444608:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848591.024709:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848591.025809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848591.030349:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611523968 00000100:00100000:0.0:1787848591.030372:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611523968 00010000:00010000:0.0:1787848591.030453:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6bf expref: 12 pid: 14344 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848591.030513:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:0.0:1787848591.030526:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+12:2352:x1874694611523968:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848591.030881:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848591.030892:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6bf expref: 12 pid: 14344 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.030909:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6bf expref: 12 pid: 14344 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.030942:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543cca35 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6bf expref: 12 pid: 14344 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.030999:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:0.0:1787848591.031006:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.031018:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.031028:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.031078:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848591.031353:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6b00587-f481-427a-8e8d-8f0f46610c6c+11:2352:x1874694611523968:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 827us (5549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848591.031365:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00010000:00010000:1.0:1787848591.031528:0:14344:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.031540:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.031580:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca66 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.031602:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.031612:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.032738:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.032762:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.032774:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848591.032808:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787848591.032857:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.032865:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.032874:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.032881:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848591.032887:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.032896:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.032912:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:1.0:1787848591.032915:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787848591.032920:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.032927:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543cca5f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787848591.032946:0:14344:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003096f5e4 reply state 00000000d9b11832 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848591.032957:0:14344:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787848591.033018:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca58 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6cd expref: 14 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.033053:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6cd expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.033061:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:1.0:1787848591.033064:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787848591.033066:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e000, rc 0) 00000100:00100000:1.0:1787848591.033173:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+14:14452:x1874694611523840:12345-192.168.201.26@tcp:101:bash.0 Request processed in 33538us (33813us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787848591.033184:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 28 00010000:00010000:3.0:1787848591.038956:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.038980:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca66 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.038988:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.038995:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e400 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848591.039002:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.039011:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca66 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.039035:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93ff5685be00) 00010000:00010000:3.0:1787848591.039039:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848591.039045:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca66 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.039051:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca66 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848591.051963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848591.052262:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611524096 00000100:00100000:2.0:1787848591.052276:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611524096 00000100:00100000:2.0:1787848591.052362:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:2.0:1787848591.052375:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+13:14452:x1874694611524096:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787848591.052414:0:15051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848591.052448:0:15051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cca7b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6d4 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848591.052556:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848591.052574:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848591.052599:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848591.052711:0:15051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787848591.052735:0:15051:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787848591.052767:0:15051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848591.052782:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848591.052814:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543cca7b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6d4 expref: 15 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848591.052842:0:15051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6d4 expref: 14 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848591.052852:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:2.0:1787848591.052855:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787848591.052860:0:15051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50665200, rc 0) 00000100:00100000:2.0:1787848591.052945:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+14:14452:x1874694611524096:12345-192.168.201.26@tcp:101:bash.0 Request processed in 573us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848591.052953:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:0.0:1787848591.058329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848591.058580:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611524352 00000100:00100000:1.0:1787848591.058606:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611524352 00000100:00100000:1.0:1787848591.058717:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:1.0:1787848591.058731:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:529328da-5578-45e5-bbcb-fef88c94f123+14:14452:x1874694611524352:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:1.0:1787848591.059332:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:529328da-5578-45e5-bbcb-fef88c94f123+15:14452:x1874694611524352:12345-192.168.201.26@tcp:35:bash.0 Request processed in 602us (1030us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787848591.059342:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:3.0:1787848591.203422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848591.203821:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611524608 00000100:00100000:1.0:1787848591.203835:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611524608 00000100:00100000:1.0:1787848591.203937:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:1.0:1787848591.203950:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+15:14462:x1874694611524608:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848591.203984:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848591.204012:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6db expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848591.204179:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787848591.204388:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca89 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6db expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.205013:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ff42d05b00) 00010000:00010000:1.0:1787848591.205019:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787848591.205028:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6db expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.205048:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f000, rc 0) 00000100:00100000:0.0:1787848591.206354:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+16:14462:x1874694611524608:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 2392us (2948us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787848591.206369:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:2.0:1787848591.213504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848591.219095:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611524864 00000100:00100000:0.0:1787848591.219129:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611524864 00000100:00100000:0.0:1787848591.219285:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:0.0:1787848591.219300:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:529328da-5578-45e5-bbcb-fef88c94f123+16:14462:x1874694611524864:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:0.0:1787848591.220062:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:529328da-5578-45e5-bbcb-fef88c94f123+17:14462:x1874694611524864:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 761us (7670us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787848591.220073:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:2.0:1787848591.283825:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848591.284080:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611525120 00000100:00100000:1.0:1787848591.284094:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611525120 00000100:00100000:1.0:1787848591.284388:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:1.0:1787848591.284413:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+17:14465:x1874694611525120:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787848591.284451:0:15051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848591.284482:0:15051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca97 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6e2 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.284631:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.284709:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.284727:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848591.284743:0:15051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787848591.284934:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543cca97 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6e2 expref: 20 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.284981:0:15051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6e2 expref: 19 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.284991:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:1.0:1787848591.284994:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787848591.284998:0:15051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e400, rc 0) 00000100:00100000:1.0:1787848591.285068:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+19:14465:x1874694611525120:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 670us (1258us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787848591.285076:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:2.0:1787848591.298948:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848591.299009:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848591.299056:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611525248 00000100:00100000:1.0:1787848591.299068:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611525248 00000100:00100000:3.0:1787848591.299127:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611525376 00000100:00100000:3.0:1787848591.299132:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611525376 00000100:00100000:1.0:1787848591.299359:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:1.0:1787848591.299373:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+20:14465:x1874694611525248:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:1.0:1787848591.299608:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.299632:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.299669:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.299704:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.299711:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.299745:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.299751:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:1.0:1787848591.299756:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.299764:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.299778:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:1.0:1787848591.299782:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787848591.299787:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.299793:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848591.299958:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+20:14465:x1874694611525248:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 588us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848591.299968:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:3.0:1787848591.309620:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:3.0:1787848591.309668:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:529328da-5578-45e5-bbcb-fef88c94f123+19:2352:x1874694611525376:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787848591.309694:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787848591.309747:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e400/0x9aeb41e0543cca9e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6e2 expref: 19 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.309772:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:3.0:1787848591.309779:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787848591.309864:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:529328da-5578-45e5-bbcb-fef88c94f123+18:2352:x1874694611525376:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 229us (10853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848591.309873:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:3.0:1787848591.309975:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848591.310130:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611525632 00000100:00100000:3.0:1787848591.310141:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611525632 00000100:00100000:3.0:1787848591.310181:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:3.0:1787848591.310189:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:529328da-5578-45e5-bbcb-fef88c94f123+18:14465:x1874694611525632:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:3.0:1787848591.310503:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:529328da-5578-45e5-bbcb-fef88c94f123+19:14465:x1874694611525632:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 315us (528us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787848591.310511:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00010000:00010000:0.0:1787848591.536478:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787848591.680335:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848591.680492:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611525888 00000100:00100000:0.0:1787848591.680516:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611525888 00000100:00100000:0.0:1787848591.680614:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:0.0:1787848591.680627:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79195a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+19:14496:x1874694611525888:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:0.0:1787848591.680708:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848591.680742:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccab3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6e9 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.680897:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccaba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.680919:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccaba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.680935:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccaba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848591.680951:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787848591.681166:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccab3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6e9 expref: 22 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.681190:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccaba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6e9 expref: 21 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.681199:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:0.0:1787848591.681202:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787848591.681207:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b57000, rc 0) 00000100:00100000:0.0:1787848591.681305:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79195a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+21:14496:x1874694611525888:12345-192.168.201.26@tcp:101:cat.0 Request processed in 680us (985us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787848591.681336:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:2.0:1787848591.703636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848591.703731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848591.704065:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611526144 00000100:00100000:3.0:1787848591.704080:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611526144 00000100:00100000:3.0:1787848591.704175:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:3.0:1787848591.704188:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:529328da-5578-45e5-bbcb-fef88c94f123+21:14496:x1874694611526144:12345-192.168.201.26@tcp:35:cat.0 00000100:00100000:3.0:1787848591.705111:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:529328da-5578-45e5-bbcb-fef88c94f123+22:14496:x1874694611526144:12345-192.168.201.26@tcp:35:cat.0 Request processed in 912us (1479us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787848591.705123:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:0.0:1787848591.713877:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611526272 00000100:00100000:0.0:1787848591.713903:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611526272 00000100:00100000:0.0:1787848591.714014:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:0.0:1787848591.714027:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529328da-5578-45e5-bbcb-fef88c94f123+22:2351:x1874694611526272:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848591.714050:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848591.714088:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccaba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6e9 expref: 22 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.714126:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:0.0:1787848591.714132:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848591.714247:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529328da-5578-45e5-bbcb-fef88c94f123+21:2351:x1874694611526272:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 224us (10514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848591.714260:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:1.0:1787848591.727954:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787848591.727989:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631444736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848591.728087:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848591.728198:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631444736 00000100:00100000:1.0:1787848591.728209:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631444736 00000100:00100000:1.0:1787848591.728298:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787848591.728310:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631444736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787848591.728361:0:15031:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787848591.728444:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631444736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848591.728453:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787848591.728479:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787848591.728545:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff805c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631444736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787848591.728884:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79196940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631444864:0@lo:400:kworker.0 00000100:00100000:3.0:1787848591.728931:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848591.728968:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631445376:0@lo:400:kworker.0 00000100:00100000:3.0:1787848591.728996:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848591.729014:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787848591.729019:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631444992:0@lo:400:kworker.0 00000100:00100000:3.0:1787848591.729041:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848591.729071:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631444864 00000100:00100000:3.0:1787848591.729074:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631444864 00000100:00100000:3.0:1787848591.729104:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787848591.729111:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3312:x1874694631444864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848591.729146:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3312:x1874694631444864:12345-0@lo:400:kworker.0 Request processed in 36us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848591.729153:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787848591.729183:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631444992 00000100:00100000:3.0:1787848591.729186:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631444992 00000100:00100000:3.0:1787848591.729223:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787848591.729230:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631444992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787848591.729259:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631444992:12345-0@lo:400:kworker.0 Request processed in 31us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848591.729265:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787848591.729293:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631444992:0@lo:400:kworker.0 00000100:00100000:3.0:1787848591.729301:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79196940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3312:1874694631444864:0@lo:400:kworker.0 00000100:00100000:2.0:1787848591.730322:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631445248:0@lo:400:kworker.0 00000100:00100000:2.0:1787848591.730376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848591.730416:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787848591.730422:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff791943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631445120:0@lo:400:kworker.0 00000100:00100000:2.0:1787848591.730454:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848591.730563:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631445376 00000100:00100000:2.0:1787848591.730570:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631445376 00000100:00100000:2.0:1787848591.730610:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631445248 00000100:00100000:2.0:1787848591.730613:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631445248 00000100:00100000:2.0:1787848591.730627:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631445120 00000100:00100000:2.0:1787848591.730629:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631445120 00000100:00100000:2.0:1787848591.730658:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787848591.730666:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79195e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631445376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848591.730713:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79195e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874694631445376:12345-0@lo:400:kworker.0 Request processed in 48us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848591.730719:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787848591.730755:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874694631445376:0@lo:400:kworker.0 00000100:00100000:2.0:1787848591.730777:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787848591.730783:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631445248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848591.730809:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631445248:12345-0@lo:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848591.730814:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787848591.730832:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79197840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631445248:0@lo:400:kworker.0 00000100:00100000:2.0:1787848591.730847:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787848591.730853:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631445120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787848591.730877:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631445120:12345-0@lo:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848591.730883:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787848591.730899:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff791943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631445120:0@lo:400:kworker.0 00000100:00080000:1.0:1787848591.731850:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848591.786805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848591.786986:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611526528 00000100:00100000:0.0:1787848591.787000:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611526528 00000100:00100000:0.0:1787848591.787086:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:0.0:1787848591.787108:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+21:14502:x1874694611526528:12345-192.168.201.26@tcp:101:dd.0 00010000:00010000:0.0:1787848591.787144:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848591.787172:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccac8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6f0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.787320:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccacf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.787338:0:14343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6cd expref: 22 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.787363:0:14343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6d4 expref: 22 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.787373:0:14343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccacf lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.787430:0:14343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6d4 expref: 22 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.787446:0:14343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6d4 expref: 22 pid: 15051 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848591.787462:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14343:1874694631445504:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848591.787594:0:14343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6cd expref: 22 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848591.787605:0:14343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6cd expref: 22 pid: 14344 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848591.787614:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bde1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14343:1874694631445632:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848591.787690:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f692c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787848591.792478:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14343:1874694631445504:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848591.792509:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bde1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14343:1874694631445632:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848591.792755:0:14343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccacf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848591.797809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848591.797901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848591.798022:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611526656 00000100:00100000:1.0:1787848591.798035:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611526656 00010000:00010000:1.0:1787848591.798094:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6d4 expref: 23 pid: 15051 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848591.798148:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611526784 00000100:00100000:1.0:1787848591.798152:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611526784 00010000:00010000:1.0:1787848591.798168:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6cd expref: 24 pid: 14344 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848591.798186:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:1.0:1787848591.798197:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff8136c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:529328da-5578-45e5-bbcb-fef88c94f123+24:2351:x1874694611526656:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848591.798225:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848591.798234:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6d4 expref: 24 pid: 15051 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798248:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6d4 expref: 24 pid: 15051 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798278:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543cca82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6d4 expref: 24 pid: 15051 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798316:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:1.0:1787848591.798322:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccacf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798332:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccacf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798341:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848591.798416:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff8136c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:529328da-5578-45e5-bbcb-fef88c94f123+23:2351:x1874694611526656:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 220us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848591.798425:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:1.0:1787848591.798489:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:1.0:1787848591.798496:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:529328da-5578-45e5-bbcb-fef88c94f123+22:2351:x1874694611526784:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848591.798515:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848591.798529:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6cd expref: 22 pid: 14344 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798540:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6cd expref: 22 pid: 14344 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798553:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543cca6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6cd expref: 22 pid: 14344 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798564:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:1.0:1787848591.798568:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccacf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798587:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccacf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798596:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccacf lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798636:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848591.798730:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:529328da-5578-45e5-bbcb-fef88c94f123+21:2351:x1874694611526784:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 233us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848591.798737:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00010000:00010000:1.0:1787848591.798779:0:14343:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccacf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.798787:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccacf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787848591.798810:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787848591.799051:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccac8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6f0 expref: 22 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.799067:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56800/0x9aeb41e0543ccacf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6f0 expref: 21 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.799075:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:1.0:1787848591.799078:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787848591.799081:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b56800, rc 0) 00000100:00100000:1.0:1787848591.799109:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+21:14502:x1874694611526528:12345-192.168.201.26@tcp:101:dd.0 Request processed in 12015us (12321us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787848591.799128:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:2.0:1787848591.804053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848591.804157:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611527040 00000100:00100000:1.0:1787848591.804171:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611527040 00000100:00100000:1.0:1787848591.804267:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:1.0:1787848591.804279:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+21:14502:x1874694611527040:12345-192.168.201.26@tcp:36:dd.0 00010000:00010000:1.0:1787848591.804708:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543ccadd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.804730:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543ccadd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.804743:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543ccadd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787848591.804804:0:15051:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787848591.804852:0:15051:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a200a203 reply state 00000000b80b7a11 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543ccadd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848591.804862:0:15051:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787848591.804989:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+24:14502:x1874694611527040:12345-192.168.201.26@tcp:36:dd.0 Request processed in 710us (947us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787848591.804998:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 35 00000020:00080000:1.0:1787848591.805004:0:15051:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787848591.809309:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543ccadd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.809336:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543ccadd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.809370:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543ccadd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.809377:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:3.0:1787848591.809383:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543ccadd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.809393:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543ccadd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.809414:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:3.0:1787848591.809417:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848591.809424:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543ccadd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.809431:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e000/0x9aeb41e0543ccadd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848591.811484:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848591.811868:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611527168 00000100:00100000:3.0:1787848591.811881:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611527168 00000100:00100000:3.0:1787848591.811965:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:3.0:1787848591.811977:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+23:14502:x1874694611527168:12345-192.168.201.26@tcp:101:dd.0 00010000:00010000:3.0:1787848591.812014:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848591.812043:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4400/0x9aeb41e0543ccae4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6f7 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848591.812931:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4400/0x9aeb41e0543ccae4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6f7 expref: 24 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848591.812956:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4400/0x9aeb41e0543ccae4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6f7 expref: 24 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848591.812988:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:2.0:1787848591.812991:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787848591.812996:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff414a4400, rc 0) 00000100:00100000:2.0:1787848591.813198:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+24:14502:x1874694611527168:12345-192.168.201.26@tcp:101:dd.0 Request processed in 1222us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848591.813218:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:2.0:1787848591.842760:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848591.842989:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611527424 00000100:00100000:1.0:1787848591.843004:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611527424 00000100:00100000:1.0:1787848591.843085:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:1.0:1787848591.843096:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:529328da-5578-45e5-bbcb-fef88c94f123+24:14502:x1874694611527424:12345-192.168.201.26@tcp:103:dd.0 00010000:00010000:1.0:1787848591.843125:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848591.843180:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4400/0x9aeb41e0543ccae4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6f7 expref: 24 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.843204:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:1.0:1787848591.843219:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848591.843976:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:529328da-5578-45e5-bbcb-fef88c94f123+23:14502:x1874694611527424:12345-192.168.201.26@tcp:103:dd.0 Request processed in 875us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848591.843988:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:2.0:1787848591.862437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848591.864704:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611527552 00000100:00100000:3.0:1787848591.864737:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611527552 00000100:00100000:3.0:1787848591.864844:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:3.0:1787848591.864876:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+23:14502:x1874694611527552:12345-192.168.201.26@tcp:58:dd.0 00010000:00010000:3.0:1787848591.865012:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.865038:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848591.865052:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787848591.875068:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787848591.875335:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787848591.875449:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787848591.875683:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+23:14502:x1874694611527552:12345-192.168.201.26@tcp:58:dd.0 Request processed in 10800us (13250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848591.875699:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:2.0:1787848591.889094:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848591.891036:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611527680 00000100:00100000:1.0:1787848591.891059:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611527680 00000100:00100000:1.0:1787848591.891174:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:1.0:1787848591.891187:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+23:14502:x1874694611527680:12345-192.168.201.26@tcp:101:dd.0 00010000:00010000:1.0:1787848591.891226:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848591.891257:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaf2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb6fe expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.891340:0:14343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.891353:0:14343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaf2 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6fe expref: 24 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.891379:0:14343:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.891394:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaf2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6fe expref: 24 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.891411:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:1.0:1787848591.891435:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787848591.891440:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaf2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6fe expref: 24 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848591.891449:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42f000, rc 0) 00000100:00100000:1.0:1787848591.891805:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+24:14502:x1874694611527680:12345-192.168.201.26@tcp:101:dd.0 Request processed in 618us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848591.891814:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 38 00000040:00080000:2.0:1787848591.984881:0:14375:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787848591.984898:0:14375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787848591.985045:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787848591.985054:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787848591.985809:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f2b7840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14375:1874694631445760:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787848591.986057:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787848591.994139:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f2b7840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14375:1874694631445760:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787848591.995237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848591.995840:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611527808 00000100:00100000:3.0:1787848591.995854:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611527808 00000100:00100000:3.0:1787848591.995984:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:3.0:1787848591.995998:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:529328da-5578-45e5-bbcb-fef88c94f123+24:14503:x1874694611527808:12345-192.168.201.26@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787848591.996121:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:529328da-5578-45e5-bbcb-fef88c94f123+24:14503:x1874694611527808:12345-192.168.201.26@tcp:900:lhsmtool_posix.0 Request processed in 126us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848591.996130:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:0.0:1787848592.005759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848592.005864:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611527936 00000100:00100000:1.0:1787848592.005878:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611527936 00000100:00100000:1.0:1787848592.005990:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:1.0:1787848592.006004:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+24:14503:x1874694611527936:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787848592.006052:0:14344:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787848592.006226:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+24:14503:x1874694611527936:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 225us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848592.006235:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00080000:3.0:1787848592.010452:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787848592.011233:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848592.011340:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611528064 00000100:00100000:0.0:1787848592.011355:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611528064 00000100:00100000:0.0:1787848592.011452:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:0.0:1787848592.011465:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+24:14503:x1874694611528064:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787848592.011586:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccaf9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.011608:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccaf9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.011622:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccaf9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015496:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb00 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015524:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015537:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015572:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb07 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015580:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015586:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787848592.015674:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787848592.015679:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787848592.015812:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015829:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccaf9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015838:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccaf9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015845:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccaf9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015850:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b57800 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848592.015855:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccaf9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015862:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccaf9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015876:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff53a89600) 00010000:00010000:0.0:1787848592.015880:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848592.015884:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccaf9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015890:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccaf9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015906:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015921:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb00 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015926:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015930:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b57000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848592.015933:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015938:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb00 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015946:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93ff42d05000) 00010000:00010000:0.0:1787848592.015948:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848592.015951:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb00 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015956:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb00 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015970:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015975:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb07 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015980:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.015985:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b56c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848592.015994:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.016002:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb07 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.016009:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:0.0:1787848592.016011:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848592.016014:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb07 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.016019:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848592.018494:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+24:14503:x1874694611528064:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 Request processed in 7018us (7257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848592.018510:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:1.0:1787848592.026785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.026890:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611528320 00000100:00100000:2.0:1787848592.026899:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611528320 00000100:00100000:2.0:1787848592.026953:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:2.0:1787848592.026965:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+24:14503:x1874694611528320:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787848592.026986:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787848592.027009:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb705 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027120:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb15 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027139:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027150:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787848592.027161:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787848592.027294:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027303:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb15 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027327:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027334:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848592.027338:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027346:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb15 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027359:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:2.0:1787848592.027362:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787848592.027367:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb15 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027373:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027414:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb0e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb705 expref: 26 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027423:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ff53a89600) 00010000:00010000:2.0:1787848592.027425:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787848592.027429:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb705 expref: 26 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.027437:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff50664a00, rc 0) 00000100:00100000:2.0:1787848592.027499:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+25:14503:x1874694611528320:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 537us (725us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787848592.027514:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:2.0:1787848592.033271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848592.033413:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611528448 00000100:00100000:1.0:1787848592.033423:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611528448 00000100:00100000:1.0:1787848592.033485:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:1.0:1787848592.033496:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+25:14503:x1874694611528448:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787848592.033757:0:14343:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787848592.033877:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+25:14503:x1874694611528448:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 382us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848592.033885:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:2.0:1787848592.043429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848592.043745:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611528704 00000100:00100000:1.0:1787848592.043755:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611528704 00000100:00100000:1.0:1787848592.043861:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:1.0:1787848592.043873:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+25:14503:x1874694611528704:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787848592.043897:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787848592.043919:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543ccb23 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb70c expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787848592.045119:0:14344:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1787848592.045129:0:14344:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1787848592.046946:0:14344:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787848592.048198:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543ccb2a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.048855:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543ccb2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.048874:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543ccb2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.048977:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42ee00/0x9aeb41e0543ccb23 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb70c expref: 28 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.049001:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543ccb2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb70c expref: 27 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.049010:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ff5685b100) 00010000:00010000:1.0:1787848592.049012:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787848592.049016:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff5f42e800, rc 0) 00000100:00100000:1.0:1787848592.049429:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+27:14503:x1874694611528704:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 5556us (6008us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787848592.049438:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:2.0:1787848592.055473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848592.055690:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611528960 00000100:00100000:0.0:1787848592.055702:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611528960 00000100:00100000:0.0:1787848592.055763:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:0.0:1787848592.055774:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+27:14503:x1874694611528960:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787848592.055838:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848592.055868:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42e800/0x9aeb41e0543ccb2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb70c expref: 27 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.055892:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ff5685b100) 00010000:00010000:0.0:1787848592.055902:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787848592.055927:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb38 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.055962:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.055974:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.055991:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa63ab4b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.055999:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa63ab4b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056005:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa63ab4b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056085:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056093:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb38 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056101:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056108:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b56c00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848592.056113:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056121:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb38 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056131:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ff53a89500) 00010000:00010000:0.0:1787848592.056141:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848592.056147:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb38 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056155:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b56c00/0x9aeb41e0543ccb38 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056165:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa63ab4b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056171:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb3f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa63ab4b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056342:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa63ab4b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056347:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b57000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848592.056350:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa63ab4b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056357:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb3f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa63ab4b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056365:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa63ab4b9 (ffff93ff42d05000) 00010000:00010000:0.0:1787848592.056367:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787848592.056370:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb3f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa63ab4b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.056375:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57000/0x9aeb41e0543ccb3f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa63ab4b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848592.056457:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+26:14503:x1874694611528960:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 684us (996us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787848592.056471:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:2.0:1787848592.059966:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848592.060050:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611529088 00000100:00100000:0.0:1787848592.060063:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611529088 00000100:00100000:0.0:1787848592.060133:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:0.0:1787848592.060143:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+26:14503:x1874694611529088:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787848592.060162:0:15051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848592.060192:0:15051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccb46 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb713 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.060236:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543ccb4d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.060250:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543ccb4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.060260:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543ccb4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.060369:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57800/0x9aeb41e0543ccb46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb713 expref: 28 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.060390:0:15051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93fe41b57200/0x9aeb41e0543ccb4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb713 expref: 27 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.060399:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ff42d05700) 00010000:00010000:0.0:1787848592.060401:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787848592.060405:0:15051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b57200, rc 0) 00000100:00100000:0.0:1787848592.060478:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+27:14503:x1874694611529088:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 336us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848592.060493:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:2.0:1787848592.066393:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848592.066626:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611529344 00000100:00100000:3.0:1787848592.066672:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611529344 00000100:00100000:3.0:1787848592.066735:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:3.0:1787848592.066745:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+27:14503:x1874694611529344:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787848592.066837:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5e00/0x9aeb41e0543ccb54 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.066853:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5e00/0x9aeb41e0543ccb54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.066864:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5e00/0x9aeb41e0543ccb54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787848592.067909:0:14343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787848592.067925:0:14343:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 540979284748ns, next at 541979281297ns, rc = 0 00000004:00010000:2.0:1787848592.068023:0:14343:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046dfc86c reply state 0000000086c9ea3b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5e00/0x9aeb41e0543ccb54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848592.068034:0:14343:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787848592.068162:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+29:14503:x1874694611529344:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 1416us (1777us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787848592.068171:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:2.0:1787848592.073673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848592.074134:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611529472 00000100:00100000:3.0:1787848592.074145:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611529472 00000100:00100000:3.0:1787848592.074228:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:3.0:1787848592.074240:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+29:14503:x1874694611529472:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787848592.074266:0:15051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848592.074289:0:15051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4a00/0x9aeb41e0543ccb5b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb71a expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.074358:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4a00/0x9aeb41e0543ccb5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb71a expref: 30 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.074372:0:15051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4a00/0x9aeb41e0543ccb5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb71a expref: 30 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.074392:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ff42d05700) 00010000:00010000:3.0:1787848592.074396:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787848592.074399:0:15051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff414a4a00, rc 0) 00000100:00100000:3.0:1787848592.074459:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+30:14503:x1874694611529472:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 221us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848592.074467:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:3.0:1787848592.079442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848592.079851:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611529600 00000100:00100000:1.0:1787848592.079861:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611529600 00000100:00080000:3.0:1787848592.080012:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787848592.080146:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:1.0:1787848592.080157:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79196940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:529328da-5578-45e5-bbcb-fef88c94f123+5:2352:x1874694611529600:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787848592.080568:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79196940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:529328da-5578-45e5-bbcb-fef88c94f123+6:2352:x1874694611529600:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 413us (1138us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787848592.080576:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:3.0:1787848592.084162:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848592.084329:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611529856 00000100:00100000:1.0:1787848592.084338:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611529856 00000100:00100000:1.0:1787848592.084396:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:1.0:1787848592.084407:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:529328da-5578-45e5-bbcb-fef88c94f123+30:14503:x1874694611529856:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787848592.084719:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:529328da-5578-45e5-bbcb-fef88c94f123+31:14503:x1874694611529856:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 313us (565us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787848592.084728:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:3.0:1787848592.088543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.088692:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611530112 00000100:00100000:2.0:1787848592.088703:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611530112 00000100:00100000:2.0:1787848592.088768:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:2.0:1787848592.088779:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+31:14503:x1874694611530112:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787848592.088895:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+31:14503:x1874694611530112:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 117us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848592.088903:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00010000:00010000:0.0:1787848592.091518:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5e00/0x9aeb41e0543ccb54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.091536:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5e00/0x9aeb41e0543ccb54 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.091544:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5e00/0x9aeb41e0543ccb54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.091550:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5e00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848592.091554:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5e00/0x9aeb41e0543ccb54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.091562:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5e00/0x9aeb41e0543ccb54 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.091582:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ff42d05700) 00010000:00010000:0.0:1787848592.091586:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787848592.091591:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5e00/0x9aeb41e0543ccb54 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.091597:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5e00/0x9aeb41e0543ccb54 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848592.093106:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848592.093331:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611530240 00000100:00100000:3.0:1787848592.093343:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611530240 00000100:00100000:3.0:1787848592.093447:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:3.0:1787848592.093459:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+30:14503:x1874694611530240:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787848592.093483:0:15051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787848592.093505:0:15051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4600/0x9aeb41e0543ccb62 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb721 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.093591:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5400/0x9aeb41e0543ccb69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.093606:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5400/0x9aeb41e0543ccb69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.093616:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5400/0x9aeb41e0543ccb69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787848592.093700:0:15051:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787848592.093731:0:15051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5400/0x9aeb41e0543ccb69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.093764:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4600/0x9aeb41e0543ccb62 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb721 expref: 32 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.093782:0:15051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5400/0x9aeb41e0543ccb69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb721 expref: 31 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.093791:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ff42d05700) 00010000:00010000:3.0:1787848592.093793:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787848592.093797:0:15051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff414a5400, rc 0) 00000100:00100000:3.0:1787848592.093873:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+31:14503:x1874694611530240:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 417us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848592.093893:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:3.0:1787848592.102038:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848592.102178:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611530368 00000100:00100000:0.0:1787848592.102188:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611530368 00000100:00100000:0.0:1787848592.102389:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:0.0:1787848592.102401:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79197840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:529328da-5578-45e5-bbcb-fef88c94f123+6:2352:x1874694611530368:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787848592.102420:0:15026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848592.102454:0:15026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb728 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787848592.102481:0:15026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a906790, blocks: 0x1 00010000:00010000:0.0:1787848592.102501:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=541s v=(0 0) 00010000:00010000:0.0:1787848592.102506:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848592.102516:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb728 expref: 7 pid: 15026 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.102537:0:15026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb728 expref: 7 pid: 15026 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.102552:0:15026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93fe41b56c00, rc 0) 00000100:00100000:0.0:1787848592.102618:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79197840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:529328da-5578-45e5-bbcb-fef88c94f123+7:2352:x1874694611530368:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 219us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848592.102625:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:1.0:1787848592.106679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.106731:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611530624 00000100:00100000:2.0:1787848592.106742:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611530624 00000100:00100000:2.0:1787848592.106825:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:2.0:1787848592.106836:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+31:14503:x1874694611530624:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787848592.107009:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:529328da-5578-45e5-bbcb-fef88c94f123+31:14503:x1874694611530624:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 176us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848592.107015:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:2.0:1787848592.109160:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848592.109393:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611530752 00000100:00100000:3.0:1787848592.109400:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611530752 00000100:00100000:3.0:1787848592.109454:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:3.0:1787848592.109464:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+31:14503:x1874694611530752:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787848592.132414:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:3.0:1787848592.132436:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1787848592.132457:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:3.0:1787848592.132486:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787848592.132754:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:529328da-5578-45e5-bbcb-fef88c94f123+16:14503:x1874694611530752:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 Request processed in 23286us (23598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848592.132766:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:0.0:1787848592.134592:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f2b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631445888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787848592.134685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787848592.134795:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631445888 00000100:00100000:1.0:1787848592.134803:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631445888 00000100:00100000:1.0:1787848592.134856:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787848592.134866:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631445888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787848592.135096:0:15029:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787848592.135101:0:15029:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787848592.135103:0:15029:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787848592.135106:0:15029:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787848592 -> 1787848592 00002000:00010000:1.0:1787848592.135121:0:15029:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787848592.135599:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.135635:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787848592.135683:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787848592.135920:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611530880 00000100:00100000:3.0:1787848592.135925:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611530880 00000100:00100000:2.0:1787848592.136055:0:16573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:2.0:1787848592.136064:0:16573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff791952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:529328da-5578-45e5-bbcb-fef88c94f123+7:2351:x1874694611530880:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787848592.136070:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874694631445888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1205us (1384us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787848592.136077:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1787848592.136144:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ff5f2b7840/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787848592.136150:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f2b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631445888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787848592.136284:0:16573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff791952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:529328da-5578-45e5-bbcb-fef88c94f123+7:2351:x1874694611530880:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 Request processed in 220us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848592.136292:0:16573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:1.0:1787848592.138246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.138302:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611531136 00000100:00100000:2.0:1787848592.138312:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611531136 00000100:00100000:2.0:1787848592.138385:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:2.0:1787848592.138396:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+14:14503:x1874694611531136:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787848592.138451:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787848592.138483:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5400/0x9aeb41e0543ccb69 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb721 expref: 14 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.138503:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ff42d05700) 00010000:00010000:2.0:1787848592.138508:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787848592.138538:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb77 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.138551:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.138577:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787848592.138794:0:14343:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000892602c3 reply state 00000000c3bd3306 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848592.138801:0:14343:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787848592.138876:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+15:14503:x1874694611531136:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 482us (637us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787848592.138883:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:1.0:1787848592.140909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848592.140949:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611531264 00000100:00100000:3.0:1787848592.140958:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611531264 00010000:00010000:0.0:1787848592.140983:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.141011:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb77 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.141019:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.141025:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:0.0:1787848592.141030:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848592.141036:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00010000:00010000:0.0:1787848592.141037:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb77 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848592.141045:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:529328da-5578-45e5-bbcb-fef88c94f123+7:14503:x1874694611531264:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787848592.141053:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ff42d05700) 00010000:00010000:0.0:1787848592.141056:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787848592.141060:0:15026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787848592.141061:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb77 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.141067:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb77 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.141075:0:15026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8a019d39353cb72f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.141119:0:15026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb728 expref: 8 pid: 15026 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.141127:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848592.141131:0:15026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848592.141143:0:15026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 8 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.141175:0:15026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb728 expref: 8 pid: 15026 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.141240:0:15026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb728 expref: 8 pid: 15026 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848592.141255:0:15026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff79249a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15026:1874694631446016:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787848592.141354:0:15026:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff48181540 going to sleep for 11 seconds 00000100:00100000:3.0:1787848592.144062:0:15026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff79249a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15026:1874694631446016:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787848592.144102:0:15026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 8 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.144122:0:15026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ff414a4600, rc 0) 00000100:00100000:3.0:1787848592.144170:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:529328da-5578-45e5-bbcb-fef88c94f123+8:14503:x1874694611531264:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 3126us (3269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848592.144191:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:2.0:1787848592.144378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848592.144522:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611531392 00000100:00100000:0.0:1787848592.144529:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611531392 00010000:00010000:0.0:1787848592.144563:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb728 expref: 8 pid: 15026 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848592.144591:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:0.0:1787848592.144600:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529328da-5578-45e5-bbcb-fef88c94f123+8:2351:x1874694611531392:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848592.144613:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848592.144636:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb728 expref: 8 pid: 15026 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.144667:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb728 expref: 8 pid: 15026 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.144691:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb728 expref: 8 pid: 15026 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.144705:0:14330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848592.144710:0:14330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848592.144716:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 7 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.144726:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 7 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.144754:0:14330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 7 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848592.144763:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdcb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14330:1874694631446144:192.168.201.26@tcp:105: 00000100:00100000:0.0:1787848592.144820:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f692240 going to sleep for 11 seconds 00000100:00100000:2.0:1787848592.149312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848592.149421:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611531520 00000100:00100000:1.0:1787848592.149430:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611531520 00000100:00100000:1.0:1787848592.149489:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:1.0:1787848592.149500:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:529328da-5578-45e5-bbcb-fef88c94f123+8:2352:x1874694611531520:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787848592.149728:0:15029:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787848592.149731:0:15029:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787848592 00002000:00010000:1.0:1787848592.149733:0:15029:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787848591 00002000:00010000:1.0:1787848592.149735:0:15029:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787848592 -> 1787848592 00002000:00010000:1.0:1787848592.149736:0:15029:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787848592.149801:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:529328da-5578-45e5-bbcb-fef88c94f123+9:2352:x1874694611531520:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 303us (498us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787848592.149809:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:0.0:1787848592.150297:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdcb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14330:1874694631446144:192.168.201.26@tcp:105: 00010000:00010000:0.0:1787848592.150323:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848592.150363:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529328da-5578-45e5-bbcb-fef88c94f123+8:2351:x1874694611531392:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 5764us (6272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848592.150609:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:2.0:1787848592.153531:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848592.153611:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611531648 00000100:00100000:0.0:1787848592.153620:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611531648 00000100:00100000:0.0:1787848592.153697:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787848592.153703:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:529328da-5578-45e5-bbcb-fef88c94f123+8:2354:x1874694611531648:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787848592.153741:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.153757:0:15028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 8 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.153764:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848592.153768:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787848592.153771:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.153799:0:15028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 8 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.153809:0:15028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 8 pid: 15026 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848592.153820:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15028:1874694631446272:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787848592.153893:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5f692240 going to sleep for 11 seconds 00000100:00100000:0.0:1787848592.155882:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15028:1874694631446272:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787848592.155918:0:15028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848592.156812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848592.157015:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611531776 00000100:00100000:1.0:1787848592.157024:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611531776 00010000:00010000:1.0:1787848592.157060:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 9 pid: 15026 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848592.157101:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:1.0:1787848592.157111:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79249a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:529328da-5578-45e5-bbcb-fef88c94f123+9:2352:x1874694611531776:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787848592.157125:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787848592.157157:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 9 pid: 15026 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.157171:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 9 pid: 15026 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.157195:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efb5761/0x9aeb41e0543ccb7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb72f expref: 9 pid: 15026 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.157225:0:14329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787848592.157229:0:14329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787848592.157236:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.157246:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.157327:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787848592.157408:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79249a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:529328da-5578-45e5-bbcb-fef88c94f123+8:2352:x1874694611531776:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 298us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848592.157417:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00010000:00010000:0.0:1787848592.158426:0:15028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.158441:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.158695:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.158705:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.158732:0:15028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.158740:0:15028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b56c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848592.158744:0:15028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.158753:0:15028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.158770:0:15028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.158779:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eff1567/0x9aeb41e0543ccb85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848592.158862:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:529328da-5578-45e5-bbcb-fef88c94f123+7:2354:x1874694611531648:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 Request processed in 5155us (5338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848592.158871:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:3.0:1787848592.162460:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.162783:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611532032 00000100:00100000:2.0:1787848592.162794:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611532032 00000100:00100000:2.0:1787848592.162932:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:2.0:1787848592.162943:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79248f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+14:14503:x1874694611532032:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787848592.163026:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543ccb8c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.163044:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543ccb8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.163054:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543ccb8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.163500:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.163523:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4a00/0x9aeb41e0543ccb5b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb71a expref: 15 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.163531:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.163571:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4a00/0x9aeb41e0543ccb5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb71a expref: 15 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.163586:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4a00/0x9aeb41e0543ccb5b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb71a expref: 15 pid: 15051 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848592.163605:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f2db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1874694631446400:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787848592.164653:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed60300 going to sleep for 11 seconds 00000100:00100000:2.0:1787848592.166712:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f2db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1874694631446400:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787848592.166743:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848592.177255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848592.178034:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611532160 00000100:00100000:0.0:1787848592.178045:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611532160 00010000:00010000:0.0:1787848592.178088:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4a00/0x9aeb41e0543ccb5b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb71a expref: 16 pid: 15051 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848592.178137:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:0.0:1787848592.178147:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79249680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529328da-5578-45e5-bbcb-fef88c94f123+16:2351:x1874694611532160:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787848592.178164:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787848592.178171:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4a00/0x9aeb41e0543ccb5b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb71a expref: 16 pid: 15051 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.178187:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4a00/0x9aeb41e0543ccb5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb71a expref: 16 pid: 15051 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.178224:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a4a00/0x9aeb41e0543ccb5b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb71a expref: 16 pid: 15051 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.178243:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ff42d05700) 00010000:00010000:0.0:1787848592.178263:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.178273:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.178280:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.178307:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787848592.178370:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79249680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529328da-5578-45e5-bbcb-fef88c94f123+15:2351:x1874694611532160:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 224us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848592.178378:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00010000:00010000:2.0:1787848592.178404:0:14344:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.178414:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787848592.179364:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787848592.180436:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787848592.180638:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787848592.180774:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f2db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14344:1874694631446528:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787848592.180903:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848592.180951:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5596b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787848592.181019:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631446528 00000100:00100000:1.0:1787848592.181028:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631446528 00000100:00100000:1.0:1787848592.181076:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787848592.181085:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14344:x1874694631446528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787848592.181181:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14344:x1874694631446528:12345-0@lo:1000:mdt00_001.0 Request processed in 96us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848592.181196:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787848592.181471:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f2db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14344:1874694631446528:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787848592.183380:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787848592.183468:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f2db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14344:1874694631446656:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787848592.183680:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787848592.183714:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed60300 going to sleep for 11 seconds 00000100:00100000:1.0:1787848592.183751:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631446656 00000100:00100000:1.0:1787848592.183760:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631446656 00000100:00100000:1.0:1787848592.183810:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787848592.183816:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14344:x1874694631446656:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787848592.183979:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14344:x1874694631446656:12345-0@lo:1000:mdt00_001.0 Request processed in 162us (300us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787848592.183987:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787848592.184015:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f2db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14344:1874694631446656:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787848592.184050:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184060:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184069:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184074:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50664a00 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848592.184080:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184089:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184196:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ff42d05700) 00010000:00010000:2.0:1787848592.184200:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787848592.184468:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184477:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50664a00/0x9aeb41e0543ccb93 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184674:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184681:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184688:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184693:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a5600 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848592.184696:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184702:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184712:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:2.0:1787848592.184715:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787848592.184722:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaf2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6fe expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184733:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaf2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6fe expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184743:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaf2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6fe expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.184799:0:14344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ff5f42f000/0x9aeb41e0543ccaf2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0x8a019d39353cb6fe expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848592.184823:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f2d83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1874694631446784:192.168.201.26@tcp:105: 00000100:00100000:2.0:1787848592.190437:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff93ff5ed60300 going to sleep for 11 seconds 00000100:00100000:3.0:1787848592.191318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.191534:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f2d83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1874694631446784:192.168.201.26@tcp:105: 00010000:00010000:2.0:1787848592.191562:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191573:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff414a5600/0x9aeb41e0543ccaeb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191605:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb9a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191618:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191628:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191659:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191667:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb9a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191673:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb9a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191679:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665000 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848592.191683:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb9a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191702:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb9a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191714:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:2.0:1787848592.191717:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787848592.191721:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb9a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191726:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665000/0x9aeb41e0543ccb9a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191737:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543ccb8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191742:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543ccb8c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191747:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543ccb8c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191752:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc1fa64f0) 00010000:00010000:2.0:1787848592.191755:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543ccb8c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191760:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543ccb8c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191767:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ff5685b800) 00010000:00010000:2.0:1787848592.191769:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787848592.191771:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543ccb8c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.191785:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665200/0x9aeb41e0543ccb8c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848592.192019:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79248f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:529328da-5578-45e5-bbcb-fef88c94f123+18:14503:x1874694611532032:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 29078us (29569us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787848592.192032:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 53 00000020:00080000:2.0:1787848592.192038:0:14344:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787848592.192096:0:14375:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787848592.192101:0:14375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787848592.192128:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787848592.192135:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787848592.193027:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611532288 00000100:00100000:1.0:1787848592.193037:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611532288 00000100:00100000:1.0:1787848592.193088:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:1.0:1787848592.193099:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f68c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:529328da-5578-45e5-bbcb-fef88c94f123+18:14502:x1874694611532288:12345-192.168.201.26@tcp:49:dd.0 00000100:00100000:1.0:1787848592.193227:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f68c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:529328da-5578-45e5-bbcb-fef88c94f123+18:14502:x1874694611532288:12345-192.168.201.26@tcp:49:dd.0 Request processed in 130us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848592.193235:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:1.0:1787848592.209158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.209249:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611532544 00000100:00100000:2.0:1787848592.209259:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611532544 00000100:00100000:2.0:1787848592.209369:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:2.0:1787848592.209381:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff805c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:529328da-5578-45e5-bbcb-fef88c94f123+18:14503:x1874694611532544:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787848592.210129:0:14347:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787848592.210268:0:14347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787848592.210312:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543ccba1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.210329:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543ccba1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.210340:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543ccba1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.210349:0:14347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543ccba1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.210355:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543ccba1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.210362:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543ccba1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.210380:0:14347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787848592.210488:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff805c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:529328da-5578-45e5-bbcb-fef88c94f123+20:14503:x1874694611532544:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 1108us (1400us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787848592.210498:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000020:00080000:2.0:1787848592.210504:0:14347:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787848592.211288:0:15400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787848592.211299:0:15400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543ccba1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.211308:0:15400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848592.211312:0:15400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543ccba1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.211322:0:15400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543ccba1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.211343:0:15400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ff42d05700) 00010000:00010000:0.0:1787848592.211346:0:15400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787848592.211351:0:15400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543ccba1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.211368:0:15400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ff50665c00/0x9aeb41e0543ccba1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.211386:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848592.211388:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848592.211390:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787848592.360613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787848592.360777:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611532672 00000100:00100000:0.0:1787848592.360787:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611532672 00000100:00100000:0.0:1787848592.360864:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:0.0:1787848592.360875:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:529328da-5578-45e5-bbcb-fef88c94f123+7:2353:x1874694611532672:12345-192.168.201.26@tcp:4:dd.0 00002000:00010000:0.0:1787848592.360920:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a906790, atime: 0x6a90678f, ctime: 0x6a906790, blocks: 0x1 00010000:00010000:0.0:1787848592.360929:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046786cd/0x9aeb41e0543ccba8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.360944:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=541s v=(0 0) 00010000:00010000:0.0:1787848592.360948:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787848592.360954:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046786cd/0x9aeb41e0543ccba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.360980:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000046786cd/0x9aeb41e0543ccba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848592.362850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787848592.363053:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787848592.363074:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787848592.363773:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.363927:0:15033:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787848592.363943:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611532800 00000100:00100000:2.0:1787848592.363950:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611532800 00000100:00100000:2.0:1787848592.364004:0:15033:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787848592.364010:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611532928 00000100:00100000:2.0:1787848592.364012:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611532928 00000100:00100000:0.0:1787848592.370845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.372467:0:15033:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787848592.372489:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611533056 00000100:00100000:2.0:1787848592.372508:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611533056 00000100:00100000:3.0:1787848592.373137:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:3.0:1787848592.373150:0:16574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5399b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:529328da-5578-45e5-bbcb-fef88c94f123+11:2353:x1874694611532800:12345-192.168.201.26@tcp:4:dd.0 00010000:00010000:3.0:1787848592.373190:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543ccbaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.373219:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848592.373224:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848592.373232:0:16574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543ccbaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.373245:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543ccbaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848592.374092:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.374128:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.374169:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787848592.374187:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787848592.374193:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787848592.374328:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611533184 00000100:00100000:2.0:1787848592.374334:0:15034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611533184 00000100:00100000:2.0:1787848592.374368:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787848592.374374:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611533312 00000100:00100000:2.0:1787848592.374376:0:15034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611533312 00000100:00100000:2.0:1787848592.374390:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787848592.374394:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611533440 00000100:00100000:2.0:1787848592.374397:0:15034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611533440 00000100:00100000:2.0:1787848592.375476:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:2.0:1787848592.375492:0:16575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79249e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:529328da-5578-45e5-bbcb-fef88c94f123+14:2354:x1874694611532928:12345-192.168.201.26@tcp:4:dd.0 00010000:00010000:2.0:1787848592.375538:0:16575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c6ebb73/0x9aeb41e0543ccbb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.375557:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848592.375561:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848592.375568:0:16575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c6ebb73/0x9aeb41e0543ccbb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.375586:0:16575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c6ebb73/0x9aeb41e0543ccbb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848592.382040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848592.382245:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1787848592.382439:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1787848592.382543:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611533568 00000100:00100000:1.0:1787848592.382554:0:15034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611533568 00000100:00100000:1.0:1787848592.388529:0:16576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:1.0:1787848592.388556:0:16576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:529328da-5578-45e5-bbcb-fef88c94f123+17:2354:x1874694611533056:12345-192.168.201.26@tcp:4:dd.0 00010000:00010000:1.0:1787848592.388603:0:16576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543ccbbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.388636:0:16576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848592.388664:0:16576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848592.388672:0:16576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543ccbbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.388687:0:16576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543ccbbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787848592.525256:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1787848592.525284:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1787848592.525290:0:15032:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1787848592.525295:0:15032:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1787848592.525316:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046786cd/0x9aeb41e0543ccba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.525331:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000046786cd/0x9aeb41e0543ccba8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.525341:0:15032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000046786cd/0x9aeb41e0543ccba8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.525349:0:15032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93fe41b56200 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848592.525354:0:15032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000046786cd/0x9aeb41e0543ccba8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.525703:0:15032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000046786cd/0x9aeb41e0543ccba8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.525720:0:16575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c6ebb73/0x9aeb41e0543ccbb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.525731:0:16575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c6ebb73/0x9aeb41e0543ccbb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.525737:0:16575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c6ebb73/0x9aeb41e0543ccbb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.525843:0:15032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000046786cd/0x9aeb41e0543ccba8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.525853:0:15032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000046786cd/0x9aeb41e0543ccba8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.525876:0:16575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665200 already unused, calling callback (ffffffffc158b440) 00010000:00010000:2.0:1787848592.525880:0:16575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c6ebb73/0x9aeb41e0543ccbb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.525888:0:16575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c6ebb73/0x9aeb41e0543ccbb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787848592.525949:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:529328da-5578-45e5-bbcb-fef88c94f123+19:2353:x1874694611532672:12345-192.168.201.26@tcp:4:dd.0 Request processed in 165070us (165343us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787848592.525960:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:1.0:1787848592.525997:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:1.0:1787848592.526012:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:529328da-5578-45e5-bbcb-fef88c94f123+18:2354:x1874694611533184:12345-192.168.201.26@tcp:4:dd.0 00010000:00010000:1.0:1787848592.526051:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000900c593d/0x9aeb41e0543ccbc4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.526075:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848592.526080:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848592.526251:0:16575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c6ebb73/0x9aeb41e0543ccbb6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.526261:0:16575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c6ebb73/0x9aeb41e0543ccbb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848592.526346:0:16575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79249e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:529328da-5578-45e5-bbcb-fef88c94f123+17:2354:x1874694611532928:12345-192.168.201.26@tcp:4:dd.0 Request processed in 150858us (162573us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787848592.526355:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00010000:00010000:1.0:1787848592.527785:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000900c593d/0x9aeb41e0543ccbc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.527808:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000900c593d/0x9aeb41e0543ccbc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787848592.536412:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:2.0:1787848592.536432:0:16575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:529328da-5578-45e5-bbcb-fef88c94f123+17:2354:x1874694611533312:12345-192.168.201.26@tcp:4:dd.0 00010000:00010000:2.0:1787848592.536477:0:16575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c20f1fd3/0x9aeb41e0543ccbcb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.536499:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848592.536504:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787848592.536511:0:16575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c20f1fd3/0x9aeb41e0543ccbcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787848592.536525:0:16575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c20f1fd3/0x9aeb41e0543ccbcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.561490:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787848592.606340:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1787848592.606633:0:16574:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:3.0:1787848592.606653:0:16574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:3.0:1787848592.606668:0:16574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543ccbaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.606682:0:16574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543ccbaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.606691:0:16574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543ccbaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.606699:0:16574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a4e00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848592.606704:0:16574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543ccbaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.606730:0:16574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543ccbaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.606754:0:16574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543ccbaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.606763:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c84b5a9/0x9aeb41e0543ccbaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.606923:0:16576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543ccbbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.606944:0:16576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543ccbbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.606952:0:16576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543ccbbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.607074:0:16576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42f400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:1.0:1787848592.607078:0:16576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543ccbbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.607086:0:16576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543ccbbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.607098:0:16576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543ccbbd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.607106:0:16576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048d2493b/0x9aeb41e0543ccbbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848592.607329:0:16574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5399b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:529328da-5578-45e5-bbcb-fef88c94f123+16:2353:x1874694611532800:12345-192.168.201.26@tcp:4:dd.0 Request processed in 234176us (244480us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787848592.607340:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:1.0:1787848592.611038:0:16576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:529328da-5578-45e5-bbcb-fef88c94f123+16:2354:x1874694611533056:12345-192.168.201.26@tcp:4:dd.0 Request processed in 222478us (240186us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787848592.611055:0:16576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:1.0:1787848592.611098:0:16576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:1.0:1787848592.611116:0:16576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f2d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:529328da-5578-45e5-bbcb-fef88c94f123+15:2354:x1874694611533440:12345-192.168.201.26@tcp:4:dd.0 00010000:00010000:1.0:1787848592.611160:0:16576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543ccbd2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.611194:0:16576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848592.611206:0:16576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787848592.611215:0:16576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543ccbd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787848592.611230:0:16576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543ccbd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848592.617590:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:3.0:1787848592.617609:0:16574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff5f244b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:529328da-5578-45e5-bbcb-fef88c94f123+15:2353:x1874694611533568:12345-192.168.201.26@tcp:4:dd.0 00010000:00010000:3.0:1787848592.617669:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543ccbd9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.617689:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848592.617694:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787848592.617702:0:16574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543ccbd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.617717:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543ccbd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787848592.683629:0:16575:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:0.0:1787848592.683661:0:16575:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1787848592.683677:0:16575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c20f1fd3/0x9aeb41e0543ccbcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.683703:0:16575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c20f1fd3/0x9aeb41e0543ccbcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.683714:0:16575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c20f1fd3/0x9aeb41e0543ccbcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.683721:0:16575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff50665c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848592.683725:0:16575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20f1fd3/0x9aeb41e0543ccbcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.683734:0:16575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20f1fd3/0x9aeb41e0543ccbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.683755:0:16575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c20f1fd3/0x9aeb41e0543ccbcb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.683764:0:16575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c20f1fd3/0x9aeb41e0543ccbcb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848592.683868:0:16575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:529328da-5578-45e5-bbcb-fef88c94f123+19:2354:x1874694611533312:12345-192.168.201.26@tcp:4:dd.0 Request processed in 147437us (309734us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787848592.683878:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00000001:00080000:0.0:1787848592.683942:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1787848592.687889:0:15032:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1787848592.687925:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000900c593d/0x9aeb41e0543ccbc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.687937:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000900c593d/0x9aeb41e0543ccbc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.687944:0:15032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000900c593d/0x9aeb41e0543ccbc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.687950:0:15032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e000 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848592.687963:0:15032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000900c593d/0x9aeb41e0543ccbc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.687973:0:15032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000900c593d/0x9aeb41e0543ccbc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.687994:0:15032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000900c593d/0x9aeb41e0543ccbc4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.688001:0:15032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000900c593d/0x9aeb41e0543ccbc4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848592.688491:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:529328da-5578-45e5-bbcb-fef88c94f123+13:2354:x1874694611533184:12345-192.168.201.26@tcp:4:dd.0 Request processed in 162478us (314395us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1787848592.688528:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00000001:00080000:1.0:1787848592.737473:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:1.0:1787848592.737499:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1787848592.737697:0:16576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543ccbd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.737735:0:16576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543ccbd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.737744:0:16576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543ccbd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.737752:0:16576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff5f42e400 already unused, calling callback (ffffffffc158b440) 00010000:00010000:0.0:1787848592.737757:0:16576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543ccbd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.737767:0:16576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543ccbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.737800:0:16576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543ccbd2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787848592.737809:0:16576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac2cb078/0x9aeb41e0543ccbd2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787848592.737917:0:16576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f2d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:529328da-5578-45e5-bbcb-fef88c94f123+7:2354:x1874694611533440:12345-192.168.201.26@tcp:4:dd.0 Request processed in 126796us (363733us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787848592.737928:0:16576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00010000:00010000:3.0:1787848592.740250:0:16574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543ccbd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.740268:0:16574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543ccbd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.740277:0:16574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543ccbd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.740285:0:16574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ff414a4c00 already unused, calling callback (ffffffffc158b440) 00010000:00010000:3.0:1787848592.740290:0:16574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543ccbd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.740300:0:16574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543ccbd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.740318:0:16574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543ccbd9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787848592.740326:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c45a4228/0x9aeb41e0543ccbd9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787848592.740456:0:16574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff5f244b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:529328da-5578-45e5-bbcb-fef88c94f123+5:2353:x1874694611533568:12345-192.168.201.26@tcp:4:dd.0 Request processed in 122849us (358424us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787848592.740466:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:1.0:1787848593.091223:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848593.091367:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848593.091402:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848593.091439:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848593.091463:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848593.091611:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848593.091699:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787848593.091736:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611533952 00000100:00100000:1.0:1787848593.091748:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611533952 00000100:00100000:1.0:1787848593.091824:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611534464 00000100:00100000:1.0:1787848593.091828:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611534464 00000100:00100000:1.0:1787848593.091852:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611534080 00000100:00100000:1.0:1787848593.091855:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611534080 00000100:00100000:1.0:1787848593.091872:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611534336 00000100:00100000:1.0:1787848593.091875:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611534336 00000100:00100000:2.0:1787848593.091917:0:16573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:2.0:1787848593.091947:0:16573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:529328da-5578-45e5-bbcb-fef88c94f123+5:2354:x1874694611533952:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848593.092078:0:16573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:529328da-5578-45e5-bbcb-fef88c94f123+5:2354:x1874694611533952:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 147us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848593.092095:0:16573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:2.0:1787848593.092126:0:16573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:2.0:1787848593.092142:0:16573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79440780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2354:x1874694611534464:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787848593.092146:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611534208 00000100:00100000:3.0:1787848593.092154:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611534208 00000100:00100000:2.0:1787848593.092201:0:16573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79440780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2354:x1874694611534464:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 50us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848593.092210:0:16573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:3.0:1787848593.092218:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611533824 00000100:00100000:3.0:1787848593.092224:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611533824 00000100:00100000:2.0:1787848593.092237:0:16573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:2.0:1787848593.092249:0:16573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff807e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:529328da-5578-45e5-bbcb-fef88c94f123+5:2354:x1874694611534080:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848593.092294:0:16573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff807e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:529328da-5578-45e5-bbcb-fef88c94f123+5:2354:x1874694611534080:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 47us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848593.092301:0:16573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:2.0:1787848593.092317:0:16573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:2.0:1787848593.092324:0:16573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2354:x1874694611534336:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848593.092347:0:16573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6b00587-f481-427a-8e8d-8f0f46610c6c+5:2354:x1874694611534336:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 24us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787848593.092352:0:16573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:3.0:1787848593.092362:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:3.0:1787848593.092382:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7fd5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:2354:x1874694611534208:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848593.092455:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:2.0:1787848593.092697:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff79443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+20:2354:x1874694611533824:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787848593.092746:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff79443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:529328da-5578-45e5-bbcb-fef88c94f123+20:2354:x1874694611533824:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 280us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848593.092786:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7fd5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6b00587-f481-427a-8e8d-8f0f46610c6c+6:2354:x1874694611534208:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 409us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848593.092795:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00080000:3.0:1787848593.092834:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787848593.092840:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787848593.092842:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787848593.093466:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694611533696 00000100:00100000:0.0:1787848593.093475:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694611533696 00000100:00100000:0.0:1787848593.093668:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:0.0:1787848593.093678:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:2354:x1874694611533696:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787848593.093735:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54655a3a-d2df-4afc-9081-6ffd334ecd56+13:2354:x1874694611533696:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 59us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848593.093743:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:2.0:1787848593.095732:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00010000:00010000:2.0:1787848593.585763:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787848594.609071:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787848594.729628:0:16615:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1787848595.312225:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f2da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631446912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787848595.312299:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848595.312877:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631446912 00000100:00100000:0.0:1787848595.312887:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631446912 00000100:00100000:0.0:1787848595.312978:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787848595.312989:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631446912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787848595.313027:0:15030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787848595.313082:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874694631446912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848595.313089:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787848595.313223:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787848595.313671:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f2da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874694631446912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787848595.631925:0:15400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787848596.273721:0:14375:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787848596.273734:0:14375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787848596.273771:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787848596.273778:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787848596.655858:0:15402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787848596.852944:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3311:1874694631447040:0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.853087:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848596.853214:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848596.853224:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631447168:0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.853263:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848596.853328:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bdd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631447296:0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.853361:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848596.853400:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631447168 00000100:00100000:0.0:1787848596.853410:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631447168 00000100:00100000:0.0:1787848596.853484:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631447296 00000100:00100000:0.0:1787848596.853488:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631447296 00000100:00100000:0.0:1787848596.853530:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787848596.853542:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631447168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.853636:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631447168:12345-0@lo:400:kworker.0 Request processed in 97us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848596.853672:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787848596.853693:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787848596.853701:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff788f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631447296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.853730:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff788f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874694631447296:12345-0@lo:400:kworker.0 Request processed in 31us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848596.853737:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787848596.853948:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787848596.853982:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1787848596.853989:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ff5f2b7840, transno 8589934595 00000004:00080000:0.0:1787848596.854001:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1787848596.854031:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631447296:0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.854046:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874694631447168:0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.854094:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787848596.854102:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631447424:0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.854152:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848596.854189:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631447424 00000100:00100000:0.0:1787848596.854193:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631447424 00000100:00100000:0.0:1787848596.854228:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787848596.854236:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631447424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.854270:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874694631447424:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848596.854276:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787848596.854298:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874694631447424:0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.854339:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631447552:0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.854361:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848596.854389:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631447552 00000100:00100000:0.0:1787848596.854393:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631447552 00000100:00100000:0.0:1787848596.854424:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787848596.854430:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631447552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.854462:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874694631447552:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848596.854469:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787848596.854483:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848596.854497:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874694631447552:0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.854522:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787848596.854528:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff55bde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631447680:0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.854550:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787848596.854570:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631447680 00000100:00100000:0.0:1787848596.854573:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631447680 00000100:00100000:0.0:1787848596.854597:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787848596.854603:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631447680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787848596.854635:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff55bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874694631447680:12345-0@lo:400:kworker.0 Request processed in 32us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1787848596.854667:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787848596.854682:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787848596.854700:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874694631447680:0@lo:400:kworker.0 00000100:00100000:1.0:1787848596.857730:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631447040 00000100:00100000:1.0:1787848596.857753:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631447040 00000100:00100000:1.0:1787848596.857842:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787848596.857855:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff7924e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3311:x1874694631447040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787848596.857995:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff7924e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ee33ef1-6a45-464a-a8ac-d296b849f06b+19:3311:x1874694631447040:12345-0@lo:400:kworker.0 Request processed in 142us (4908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787848596.858003:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787848596.858119:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff55bdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ee33ef1-6a45-464a-a8ac-d296b849f06b:3311:1874694631447040:0@lo:400:kworker.0 00000100:00100000:1.0:1787848596.861320:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787848596.861360:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93ff5f247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631447808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787848596.861623:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787848596.863465:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874694631447808 00000100:00100000:3.0:1787848596.863486:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874694631447808 00000100:00100000:3.0:1787848596.863585:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787848596.863599:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ff58d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631447808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787848596.863692:0:16426:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1787848596.863810:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ff58d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874694631447808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 214us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787848596.863819:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787848596.864042:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93ff5f247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874694631447808:0@lo:13:osp-pre-1-0.0 Debug log: 30712 lines, 30712 kept, 0 dropped, 0 bad.